A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
This report summarizes scanner evidence for microsoft/FLAML, a Jupyter Notebook project with 4,417 GitHub stars. SynthScan examined 69,222 lines of code across 381 source files, recording 885 pattern matches distributed across 19 syntactic categories. The legacy adjusted pattern signal is 17.8 (Elevated pattern signal); it is not an authorship estimate.
Use the findings to ask whether maintainers can explain intent, verify dependencies, simplify unnecessary scaffolding, and focus review effort. Risk Payload v1 adds ownership, supply-chain, over-engineering, and review-effort vectors when available. These are prompts for human verification, not probabilities, security findings, or measured maintenance costs.
Use each vector to guide manual verification of the underlying findings.
Payload schema: 1.0.0 · Engine: 2.0.0 · Scoring: heuristic-density-v1 · Scan date: 2026-10-31.
Can maintainers explain intent, assumptions, and trade-offs? 524 finding(s).
Are imports declared and package/API names verified? 225 finding(s).
Are wrappers, guards, and repeated structures necessary? 473 finding(s).
Which changes need focused human review? 885 finding(s).
This chart tracks the legacy adjusted pattern score across scan runs. Changes can reflect source changes, scan coverage, or detector/scoring versions; they do not measure AI adoption or prove that a team refactored code. Compare runs only when their scoring versions are compatible. The dashed line tracks the raw pattern-hit count.
Groups findings by configured severity weight. Severity is not a confidence estimate, security rating, or proof that a package is missing. Verify imports against the project's manifests and inspect each finding in its local design context.
This horizontal bar chart shows where configured pattern scores accumulate across directories. Treat the bars as locations to inspect, not as evidence of authorship or code quality. Use the file-level findings to decide whether a directory needs a focused ownership, dependency, complexity, or review check.
The scanner identified 885 distinct pattern matches across 19 syntactic categories. Each entry below represents a discrete location in the source code where the engine recorded a detector match to inspect in context. Expand any category row to inspect the individual file paths, line numbers, code snippets, and the lexical context (CODE, COMMENT, or STRING) in which each match was detected.
Reading the findings table: The Severity column indicates the configured finding weight (CRITICAL / HIGH / MEDIUM / LOW). The Context column identifies whether the match occurred inside executable code, an inline comment, or a string literal — legacy comment-context matches receive a ×1.5 score weight. The ⚡ bolt icon marks clustered matches: three or more patterns within a 10-line window, each receiving an additional ×1.5 density multiplier under the legacy scoring model.
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test/conftest.py | 22 | def evaluate_cv_folds_with_underlying_model(X_train_all, y_train_all, kf, model: Any, task: str) -> List[float]: | CODE |
| LOW | test/test_packaging.py | 8 | def test_pyarrow_test_dependency(self): | CODE |
| LOW | test/test_autovw.py | 377 | def test_vw_oml_problem_and_vanilla_vw(self): | CODE |
| LOW | test/test_autovw.py | 392 | def test_supervised_vw_tune_namespace(self): | CODE |
| LOW | test/test_autovw.py | 415 | def test_supervised_vw_tune_namespace_learningrate(self): | CODE |
| LOW | test/test_autovw.py | 441 | def test_bandit_vw_tune_namespace(self): | CODE |
| LOW | test/test_autovw.py | 444 | def test_bandit_vw_tune_namespace_learningrate(self): | CODE |
| LOW | test/default/test_defaults.py | 76 | def test_suggest_classification(): | CODE |
| LOW⚡ | test/default/test_defaults.py | 290 | def test_suggested_config_changes_do_not_affect_later_suggestions(estimator, task): | CODE |
| LOW | test/default/test_defaults.py | 301 | def test_suggest_config_preserves_user_predictor(): | CODE |
| LOW | test/automl/test_extra_models.py | 180 | def _test_sparse_matrix_classification(estimator): | CODE |
| LOW | test/automl/test_extra_models.py | 219 | def test_load_multi_dataset_aggregates_without_resample(): | CODE |
| LOW | test/automl/test_split.py | 58 | def test_time_split_with_sample_weight(): | CODE |
| LOW | test/automl/test_split.py | 80 | def test_group_split_with_sample_weight_alignment(): | CODE |
| LOW | test/automl/test_split.py | 131 | def test_group_split_with_sample_weight_series_alignment(): | CODE |
| LOW | test/automl/test_split.py | 189 | def test_groups_for_classification_task(): | CODE |
| LOW | test/automl/test_split.py | 227 | def test_groups_for_regression_task(): | CODE |
| LOW | test/automl/test_split.py | 256 | def test_groups_with_sample_weights(): | CODE |
| LOW | test/automl/test_split.py | 297 | def test_stratified_groupkfold(): | CODE |
| LOW | test/automl/test_training_log_append.py | 15 | def test_appended_trial_can_be_loaded_from_checkpoint(tmp_path): | CODE |
| LOW | test/automl/test_training_log_append.py | 31 | def test_append_uses_next_unused_record_id(tmp_path, existing_ids): | CODE |
| LOW | test/automl/test_training_log_append.py | 54 | def test_append_creates_missing_log(tmp_path): | CODE |
| LOW | test/automl/test_training_log_append.py | 63 | def test_appended_checkpoint_keeps_current_run_best(tmp_path): | CODE |
| LOW | test/automl/test_training_log_append.py | 78 | def test_append_skips_checkpoint_only_log(tmp_path): | CODE |
| LOW | test/automl/test_training_log_append.py | 89 | def test_append_preserves_valid_record_and_checkpoint_tails(tmp_path, checkpoint_tail, line_ending): | CODE |
| LOW | test/automl/test_training_log_append.py | 111 | def test_writer_does_not_wait_for_another_fit(tmp_path, append): | CODE |
| LOW | test/automl/test_training_log_append.py | 135 | def test_writer_closes_after_context_error(tmp_path, append): | CODE |
| LOW | test/automl/test_training_log_append.py | 148 | def test_append_preserves_invalid_log(tmp_path): | CODE |
| LOW | test/automl/test_training_log_append.py | 160 | def test_writer_handles_open_error(tmp_path): | CODE |
| LOW | test/automl/test_training_log_append.py | 170 | def test_default_writer_overwrites_existing_records(tmp_path): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 6 | def test_daily_time_idx_counts_steps(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 12 | def test_daily_time_idx_with_shared_timestamps(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 20 | def test_month_end_time_idx_with_shared_timestamps(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 27 | def test_tz_aware_daily_time_idx_across_dst(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 34 | def test_tz_aware_business_day_time_idx_across_dst(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 41 | def test_irregular_time_idx_keeps_gaps(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 48 | def test_irregular_time_idx_uses_a_step_that_divides_every_gap(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 56 | def test_tz_aware_hourly_time_idx_keeps_a_missing_dst_fold_hour(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 64 | def test_tz_aware_irregular_daily_time_idx_across_dst(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 74 | def test_sparse_month_end_time_idx_counts_months(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 82 | def test_sparse_quarter_end_time_idx_counts_quarters(): | CODE |
| LOW⚡ | test/automl/test_add_time_idx_col.py | 89 | def test_tz_aware_same_day_of_month_time_idx_keeps_both_dst_fold_hours(): | CODE |
| LOW | test/automl/test_add_time_idx_col.py | 101 | def test_tz_aware_dst_fold_hours_then_same_day_of_month_get_distinct_time_idx(): | CODE |
| LOW | test/automl/test_add_time_idx_col.py | 111 | def test_regular_grid_check_builds_one_candidate_per_date(monkeypatch): | CODE |
| LOW | test/automl/test_datetime_missing.py | 25 | def test_fit_imputes_missing_datetime_from_valid_ordinals(utc): | CODE |
| LOW | test/automl/test_datetime_missing.py | 43 | def test_transform_uses_training_datetime_median(utc, all_missing): | CODE |
| LOW⚡ | test/automl/test_datetime_missing.py | 59 | def test_valid_datetimes_keep_their_ordinals(utc): | CODE |
| LOW⚡ | test/automl/test_datetime_missing.py | 69 | def test_all_missing_training_datetime_is_still_dropped(): | CODE |
| LOW⚡ | test/automl/test_datetime_missing.py | 77 | def test_task_validation_and_preprocess_impute_missing_datetimes(task_name): | CODE |
| LOW | test/automl/test_rouge_metric.py | 25 | def test_rouge_loss_supports_current_and_legacy_scores( | CODE |
| LOW⚡ | test/automl/test_rouge_metric.py | 55 | def test_non_rouge_metric_keeps_its_loss_direction(metric_modules): | CODE |
| LOW⚡ | test/automl/test_rouge_metric.py | 64 | def test_missing_huggingface_dependency_keeps_helpful_error(monkeypatch): | CODE |
| LOW⚡ | test/automl/test_rouge_metric.py | 71 | def test_missing_metric_keeps_helpful_error(monkeypatch, metric_modules): | CODE |
| LOW | test/automl/test_resampler.py | 88 | def test_resampler_hook_fires_per_fold_and_balances_train(): | CODE |
| LOW | test/automl/test_resampler.py | 109 | def test_resampler_runs_on_final_fit_with_max_iter_one(): | CODE |
| LOW | test/automl/test_resampler.py | 126 | def test_resampler_with_ensemble_raises(): | CODE |
| LOW | test/automl/test_resampler.py | 143 | def test_resampler_disables_auto_augment_for_rare_classes(): | CODE |
| LOW | test/automl/test_resampler.py | 162 | def test_resampler_leaves_validation_untouched(): | CODE |
| LOW | test/automl/test_resampler.py | 195 | def test_resampler_with_sample_weight_raises(): | CODE |
| LOW | test/automl/test_resampler.py | 210 | def test_resampler_with_groups_raises(): | CODE |
| 263 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | test/automl/test_model.py | 111 | except ValueError: | CODE |
| HIGH | test/automl/test_model.py | 122 | except ValueError: | CODE |
| HIGH | test/automl/test_split.py | 219 | except AssertionError: | CODE |
| HIGH | test/automl/test_notebook_example.py | 183 | except ImportError: | CODE |
| HIGH | test/automl/test_score.py | 221 | except NotImplementedError: | CODE |
| HIGH | test/automl/test_multiclass.py | 285 | except ImportError: | CODE |
| HIGH | test/automl/test_multiclass.py | 559 | except ImportError: | CODE |
| HIGH | test/automl/test_warmstart.py | 222 | except AssertionError: | CODE |
| HIGH | test/tune/test_searcher.py | 47 | except ValueError: | CODE |
| HIGH | test/tune/test_searcher.py | 74 | except AttributeError: | CODE |
| HIGH | test/tune/test_searcher.py | 86 | except ValueError: | CODE |
| HIGH | test/tune/test_searcher.py | 91 | except AttributeError: | CODE |
| HIGH | test/tune/test_searcher.py | 96 | except ValueError: | CODE |
| HIGH | test/tune/test_searcher.py | 101 | except TypeError: | CODE |
| HIGH | test/tune/test_searcher.py | 106 | except TypeError: | CODE |
| HIGH | test/tune/test_searcher.py | 111 | except ValueError: | CODE |
| HIGH | test/tune/test_searcher.py | 116 | except TypeError: | CODE |
| HIGH | test/tune/test_searcher.py | 121 | except ValueError: | CODE |
| HIGH | test/tune/test_searcher.py | 128 | except ValueError: | CODE |
| HIGH | test/tune/test_searcher.py | 140 | except ValueError: | CODE |
| HIGH | test/tune/test_searcher.py | 146 | except TypeError: | CODE |
| HIGH | test/tune/test_searcher.py | 152 | except TypeError: | CODE |
| HIGH | test/tune/test_searcher.py | 158 | except RuntimeError: | CODE |
| HIGH | test/tune/test_searcher.py | 163 | except RuntimeError: | CODE |
| HIGH | test/tune/test_searcher.py | 169 | except RuntimeError: | CODE |
| HIGH | test/tune/test_searcher.py | 174 | except RuntimeError: | CODE |
| HIGH | test/tune/test_searcher.py | 196 | except AssertionError: | CODE |
| HIGH | test/tune/test_space.py | 107 | except ValueError: | CODE |
| HIGH | test/tune/test_space.py | 121 | except TuneError: | CODE |
| HIGH | test/autogen/oai/test_completion.py | 36 | except ValueError: | CODE |
| HIGH | test/spark/test_mlflow.py | 24 | except ImportError: | CODE |
| HIGH | flaml/default/suggest.py | 16 | except ImportError: | CODE |
| HIGH | flaml/default/portfolio.py | 82 | except KeyError: # no "default" | CODE |
| HIGH | flaml/default/portfolio.py | 112 | except FileNotFoundError: | CODE |
| HIGH | flaml/automl/model.py | 106 | except ValueError: | CODE |
| HIGH | flaml/automl/model.py | 97 | except ValueError: | CODE |
| HIGH | flaml/automl/model.py | 117 | except ValueError: | CODE |
| HIGH | flaml/automl/ml.py | 31 | except ImportError: | CODE |
| HIGH | flaml/automl/training_log.py | 79 | except FileNotFoundError: | CODE |
| HIGH | flaml/automl/automl.py | 1727 | except Exception: | CODE |
| HIGH | flaml/automl/automl.py | 2687 | except FileNotFoundError: | CODE |
| HIGH | flaml/automl/automl.py | 1527 | except Exception: | CODE |
| HIGH | flaml/automl/automl.py | 2674 | except FileNotFoundError: | CODE |
| HIGH | flaml/automl/automl.py | 1695 | except Exception: | CODE |
| HIGH | flaml/automl/data.py | 27 | except ImportError: | CODE |
| HIGH | flaml/automl/data.py | 921 | except Exception: | CODE |
| HIGH | flaml/automl/data.py | 911 | except TypeError: | CODE |
| HIGH | flaml/automl/data.py | 891 | except Exception: | CODE |
| HIGH | flaml/automl/task/time_series_task.py | 494 | except ImportError: | CODE |
| HIGH | flaml/automl/task/generic_task.py | 24 | except ImportError: | CODE |
| HIGH | flaml/automl/task/generic_task.py | 37 | except ImportError: | CODE |
| HIGH | flaml/automl/task/generic_task.py | 1345 | except ImportError: | CODE |
| HIGH | flaml/onlineml/trial.py | 14 | except ImportError: | CODE |
| HIGH | flaml/fabric/mlflow.py | 257 | except Exception: | CODE |
| HIGH | flaml/fabric/mlflow.py | 372 | except Exception: | CODE |
| HIGH | flaml/fabric/mlflow.py | 422 | except mlflow.exceptions.MlflowException: | CODE |
| HIGH | flaml/autogen/oai/completion.py | 950 | except ValueError: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test/conftest.py | 1 | CODE | |
| LOW | test/conftest.py | 1 | CODE | |
| LOW | test/conftest.py | 4 | CODE | |
| LOW | test/test_autovw.py | 4 | CODE | |
| LOW | test/automl/test_extra_models.py | 24 | CODE | |
| LOW | test/automl/test_sklearn_17_compat.py | 8 | CODE | |
| LOW | test/automl/test_free_mem_ratio.py | 1 | CODE | |
| LOW | test/automl/test_forecast.py | 801 | CODE | |
| LOW | test/automl/test_forecast.py | 37 | CODE | |
| LOW | test/automl/test_forecast.py | 545 | CODE | |
| LOW | test/automl/test_forecast.py | 670 | CODE | |
| LOW | test/automl/test_forecast.py | 995 | CODE | |
| LOW | test/automl/test_custom_hp.py | 9 | CODE | |
| LOW | test/automl/test_score.py | 39 | CODE | |
| LOW | test/automl/test_warmstart.py | 180 | CODE | |
| LOW | test/automl/test_no_overlap.py | 3 | CODE | |
| LOW | test/pipeline_tuning_example/train/train.py | 5 | CODE | |
| LOW | test/tune/test_searcher.py | 324 | CODE | |
| LOW | test/tune/example_scheduler.py | 1 | CODE | |
| LOW | test/tune/test_sample.py | 6 | CODE | |
| LOW | test/tune/test_sample.py | 6 | CODE | |
| LOW | test/tune/test_sample.py | 6 | CODE | |
| LOW | test/tune/test_sample.py | 6 | CODE | |
| LOW | test/tune/test_sample.py | 6 | CODE | |
| LOW | test/tune/test_lexiflow.py | 3 | CODE | |
| LOW | test/tune/test_flaml_raytune_consistency.py | 6 | CODE | |
| LOW | test/tune/test_tune.py | 6 | CODE | |
| LOW | test/tune/test_tune.py | 9 | CODE | |
| LOW | test/tune/test_tune.py | 117 | CODE | |
| LOW | test/tune/test_search_thread.py | 3 | CODE | |
| LOW | test/nlp/test_autohf_cv.py | 9 | CODE | |
| LOW | test/nlp/test_default.py | 11 | CODE | |
| LOW | test/nlp/test_autohf_classificationhead.py | 13 | CODE | |
| LOW | test/nlp/test_autohf_classificationhead.py | 13 | CODE | |
| LOW | test/nlp/test_autohf_classificationhead.py | 13 | CODE | |
| LOW | test/nlp/test_autohf_classificationhead.py | 9 | CODE | |
| LOW | test/nlp/test_autohf_multichoice_classification.py | 9 | CODE | |
| LOW | test/nni/mnist.py | 13 | CODE | |
| LOW | test/autogen/test_code.py | 238 | CODE | |
| LOW | test/autogen/test_notebook.py | 7 | CODE | |
| LOW | test/autogen/agentchat/test_async.py | 51 | CODE | |
| LOW | test/autogen/agentchat/test_math_user_proxy_agent.py | 20 | CODE | |
| LOW | test/autogen/agentchat/test_assistant_agent.py | 20 | CODE | |
| LOW | test/autogen/agentchat/test_assistant_agent.py | 64 | CODE | |
| LOW | test/autogen/agentchat/test_assistant_agent.py | 118 | CODE | |
| LOW | test/autogen/agentchat/test_assistant_agent.py | 161 | CODE | |
| LOW | test/autogen/agentchat/extensions/tsp.py | 5 | CODE | |
| LOW | test/autogen/agentchat/extensions/tsp.py | 6 | CODE | |
| LOW | test/autogen/agentchat/extensions/tsp.py | 8 | CODE | |
| LOW | test/autogen/agentchat/extensions/tsp.py | 9 | CODE | |
| LOW | test/autogen/oai/test_completion.py | 123 | CODE | |
| LOW | test/autogen/oai/test_completion.py | 212 | CODE | |
| LOW | test/autogen/oai/test_completion.py | 331 | CODE | |
| LOW | test/spark/test_utils.py | 17 | CODE | |
| LOW | test/spark/test_overtime.py | 11 | CODE | |
| LOW | test/spark/test_overtime.py | 13 | CODE | |
| LOW | test/spark/test_multiclass.py | 23 | CODE | |
| LOW | test/spark/test_mlflow.py | 3 | CODE | |
| LOW | test/spark/test_mlflow.py | 11 | CODE | |
| LOW | test/spark/test_mlflow.py | 22 | CODE | |
| 154 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test/test_packaging.py | 8 | CODE | |
| LOW | test/test_autovw.py | 45 | CODE | |
| LOW | test/automl/test_training_log.py | 14 | CODE | |
| LOW | test/automl/test_forecast.py | 601 | CODE | |
| LOW | test/automl/test_forecast.py | 607 | CODE | |
| LOW | test/tune/test_pytorch_cifar10.py | 189 | CODE | |
| LOW | test/tune/test_scheduler.py | 56 | CODE | |
| LOW | test/tune/test_tune.py | 115 | CODE | |
| LOW | test/nlp/test_autohf.py | 15 | CODE | |
| LOW | test/nlp/test_autohf_tokenclassification.py | 18 | CODE | |
| LOW | test/nlp/test_autohf_tokenclassification.py | 71 | CODE | |
| LOW | test/autogen/test_notebook.py | 17 | CODE | |
| LOW | flaml/default/suggest.py | 24 | CODE | |
| LOW | flaml/automl/model.py | 391 | CODE | |
| LOW | flaml/automl/model.py | 1475 | CODE | |
| LOW | flaml/automl/model.py | 1569 | CODE | |
| LOW | flaml/automl/model.py | 2123 | CODE | |
| LOW | flaml/automl/model.py | 2258 | CODE | |
| LOW | flaml/automl/ml.py | 99 | CODE | |
| LOW | flaml/automl/ml.py | 200 | CODE | |
| LOW | flaml/automl/training_log.py | 71 | CODE | |
| LOW | flaml/automl/automl.py | 1016 | CODE | |
| LOW | flaml/automl/automl.py | 1446 | CODE | |
| LOW | flaml/automl/automl.py | 1699 | CODE | |
| LOW | flaml/automl/automl.py | 1867 | CODE | |
| LOW | flaml/automl/automl.py | 2785 | CODE | |
| LOW | flaml/automl/automl.py | 2981 | CODE | |
| LOW | flaml/automl/automl.py | 3275 | CODE | |
| LOW | flaml/automl/automl.py | 3544 | CODE | |
| LOW | flaml/automl/automl.py | 1475 | CODE | |
| LOW | flaml/automl/automl.py | 1515 | CODE | |
| LOW | flaml/automl/data.py | 151 | CODE | |
| LOW | flaml/automl/data.py | 246 | CODE | |
| LOW | flaml/automl/data.py | 694 | CODE | |
| LOW | flaml/automl/data.py | 812 | CODE | |
| LOW | flaml/automl/data.py | 324 | CODE | |
| LOW | flaml/automl/data.py | 469 | CODE | |
| LOW | flaml/automl/state.py | 57 | CODE | |
| LOW | flaml/automl/task/time_series_task.py | 96 | CODE | |
| LOW | flaml/automl/task/generic_task.py | 103 | CODE | |
| LOW | flaml/automl/task/generic_task.py | 309 | CODE | |
| LOW | flaml/automl/task/generic_task.py | 369 | CODE | |
| LOW | flaml/automl/task/generic_task.py | 501 | CODE | |
| LOW | flaml/automl/task/generic_task.py | 828 | CODE | |
| LOW | flaml/automl/task/generic_task.py | 1096 | CODE | |
| LOW | flaml/automl/task/generic_task.py | 1132 | CODE | |
| LOW | flaml/automl/task/generic_task.py | 1161 | CODE | |
| LOW | flaml/automl/task/generic_task.py | 1294 | CODE | |
| LOW | flaml/automl/task/generic_task.py | 1374 | CODE | |
| LOW | flaml/automl/nlp/utils.py | 14 | CODE | |
| LOW | flaml/automl/nlp/utils.py | 38 | CODE | |
| LOW | flaml/automl/nlp/huggingface/utils.py | 26 | CODE | |
| LOW | flaml/automl/nlp/huggingface/utils.py | 79 | CODE | |
| LOW | flaml/automl/nlp/huggingface/utils.py | 312 | CODE | |
| LOW | flaml/automl/nlp/huggingface/utils.py | 375 | CODE | |
| LOW | flaml/automl/nlp/huggingface/utils.py | 388 | CODE | |
| LOW | flaml/automl/time_series/ts_data.py | 229 | CODE | |
| LOW | flaml/automl/time_series/ts_data.py | 385 | CODE | |
| LOW | flaml/automl/time_series/ts_model.py | 336 | CODE | |
| LOW | flaml/automl/spark/metrics.py | 50 | CODE | |
| 59 more matches not shown… | ||||
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH⚡ | test/automl/test_pandas_preprocessing.py | 22 | assert result.index.equals(pd.RangeIndex(3)) | CODE |
| HIGH | test/automl/test_pandas_preprocessing.py | 72 | assert predicted.columns.equals(fitted.columns) | CODE |
| HIGH⚡ | test/automl/test_pandas_preprocessing.py | 103 | assert state.y_train_all.index.equals(pd.RangeIndex(6)) | CODE |
| HIGH⚡ | test/automl/test_pandas_preprocessing.py | 105 | assert state.X_train_all.index.equals(pd.RangeIndex(6)) | CODE |
| HIGH⚡ | test/automl/test_pandas_preprocessing.py | 110 | assert state.sample_weight_all.index.equals(pd.RangeIndex(6)) | CODE |
| HIGH⚡ | test/automl/test_pandas_preprocessing.py | 111 | assert labels.index.equals(index) | CODE |
| HIGH⚡ | test/spark/test_utils.py | 267 | assert d1.equals(d2) | STRING |
| HIGH⚡ | test/spark/test_utils.py | 270 | assert d1.equals(d2) | STRING |
| HIGH | flaml/automl/data.py | 318 | return grid.equals(dates) | CODE |
| HIGH⚡ | flaml/automl/state.py | 32 | (1) If the type of the starting point does not match the required type in search space, return false | STRING |
| HIGH⚡ | flaml/automl/state.py | 33 | (2) If the starting point is not in the required search space, return false | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test/automl/test_regression.py | 304 | except Exception: | CODE |
| LOW | test/nni/mnist.py | 210 | except Exception as exception: | CODE |
| LOW | flaml/automl/ml.py | 137 | except Exception: | CODE |
| LOW | flaml/automl/automl.py | 493 | except Exception: | CODE |
| LOW | flaml/automl/automl.py | 549 | except Exception as e: | CODE |
| LOW | flaml/automl/automl.py | 1494 | except Exception: | CODE |
| LOW | flaml/automl/automl.py | 1509 | except Exception: | CODE |
| LOW | flaml/automl/automl.py | 1527 | except Exception: | CODE |
| LOW | flaml/automl/automl.py | 1638 | except Exception as e: | CODE |
| LOW | flaml/automl/automl.py | 1658 | except Exception: | CODE |
| LOW | flaml/automl/automl.py | 1695 | except Exception: | CODE |
| LOW | flaml/automl/automl.py | 1727 | except Exception: | CODE |
| LOW | flaml/automl/automl.py | 1760 | except Exception as e: | CODE |
| LOW | flaml/automl/automl.py | 1778 | except Exception as e: | CODE |
| LOW | flaml/automl/automl.py | 3520 | except Exception as e: | CODE |
| LOW | flaml/automl/automl.py | 3527 | except Exception as e: | CODE |
| MEDIUM | flaml/automl/data.py | 310 | def _is_regular_grid(dates, freq): | CODE |
| LOW | flaml/automl/data.py | 314 | except Exception: | CODE |
| LOW | flaml/automl/data.py | 891 | except Exception: | CODE |
| LOW | flaml/automl/data.py | 921 | except Exception: | CODE |
| LOW | flaml/automl/task/time_series_task.py | 155 | except Exception: | CODE |
| LOW | flaml/automl/time_series/ts_model.py | 422 | except Exception as e: | CODE |
| LOW | flaml/automl/spark/__init__.py | 59 | except Exception: | CODE |
| LOW | flaml/automl/spark/__init__.py | 75 | except Exception: | CODE |
| LOW | flaml/automl/spark/__init__.py | 95 | except Exception: | CODE |
| LOW | flaml/automl/spark/utils.py | 65 | except Exception: | CODE |
| LOW | flaml/tune/searcher/suggestion.py | 97 | except Exception: # pragma: no cover | CODE |
| LOW | flaml/tune/searcher/suggestion.py | 824 | except Exception as exc: | CODE |
| LOW | flaml/tune/searcher/blendsearch.py | 231 | except Exception: | CODE |
| MEDIUM | flaml/fabric/mlflow.py | 135 | def get_mlflow_log_latency(model_history=False, delete_run=True): | CODE |
| LOW | flaml/fabric/mlflow.py | 257 | except Exception: | CODE |
| LOW | flaml/fabric/mlflow.py | 290 | except Exception as e: | CODE |
| LOW | flaml/fabric/mlflow.py | 372 | except Exception: | CODE |
| LOW | flaml/fabric/mlflow.py | 572 | except Exception as e: | CODE |
| LOW | flaml/autogen/math_utils.py | 42 | except Exception: | CODE |
| LOW | flaml/autogen/math_utils.py | 99 | except Exception: | CODE |
| LOW | flaml/autogen/math_utils.py | 136 | except Exception: | CODE |
| LOW | flaml/autogen/math_utils.py | 279 | except Exception: | CODE |
| LOW | flaml/autogen/agentchat/conversable_agent.py | 975 | except Exception as e: | CODE |
| LOW | …aml/autogen/agentchat/contrib/math_user_proxy_agent.py | 417 | except Exception: | CODE |
| LOW | …aml/autogen/agentchat/contrib/math_user_proxy_agent.py | 446 | except Exception: | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test/tune/test_space.py | 21 | # Sample a float uniformly between 0.0001 and 0.1, while | COMMENT |
| LOW | test/tune/test_restore.py | 81 | COMMENT | |
| LOW | test/autogen/test_code.py | 21 | # def test_find_code(): | COMMENT |
| LOW | test/autogen/test_code.py | 41 | # # "gpt-3.5-turbo-16k-0613", | COMMENT |
| LOW | test/autogen/test_code.py | 61 | # print('Hello, World! printed to hello.txt') | COMMENT |
| LOW | test/autogen/test_code.py | 81 | # }, | COMMENT |
| LOW | test/autogen/test_code.py | 101 | # Please execute the above Python code to save a pandas df with 3 rows and 3 columns to disk. | COMMENT |
| LOW | test/autogen/test_code.py | 121 | # "role": "user", | COMMENT |
| LOW | test/autogen/agentchat/test_conversable_agent.py | 181 | # test_context() | COMMENT |
| LOW | test/autogen/agentchat/test_assistant_agent.py | 201 | test_gpt35() | COMMENT |
| LOW | test/spark/test_utils.py | 441 | # test ndcg | COMMENT |
| LOW | test/spark/test_mlflow.py | 341 | # test_tune_autolog_parentrun_nonparallel() | COMMENT |
| LOW | test/spark/test_0sparkml.py | 421 | # cProfile.run("_test_spark_large_df()", "_test_spark_large_df.profile") | COMMENT |
| LOW | website/docusaurus.config.js | 61 | { | COMMENT |
| LOW | website/docs/Use-Cases/Tune-User-Defined-Function.md | 161 | # mean=10 and sd=2 | COMMENT |
| LOW | website/src/components/HomepageFeatures.js | 21 | description: ( | COMMENT |
| LOW | flaml/default/portfolio.py | 141 | # for i, task in enumerate(neighbors): | COMMENT |
| LOW | flaml/automl/model.py | 741 | # ) and n_iter > 1: | COMMENT |
| LOW | flaml/automl/model.py | 761 | # if ( | COMMENT |
| LOW | flaml/automl/data.py | 521 | X[column] = X[column].cat.add_categories("__NAN__") | COMMENT |
| LOW | flaml/automl/task/generic_task.py | 1341 | try: | COMMENT |
| LOW | flaml/automl/time_series/sklearn.py | 161 | # TODO: do we want auto-clipping? | COMMENT |
| LOW | flaml/automl/time_series/sklearn.py | 181 | # **{col: X[col] != "" for col in X.filter(like="_holiday_").columns} | COMMENT |
| LOW | flaml/tune/trial.py | 1 | # Copyright 2020 The Ray Authors. | COMMENT |
| LOW | flaml/tune/analysis.py | 1 | # Copyright 2020 The Ray Authors. | COMMENT |
| LOW | flaml/tune/result.py | 1 | # Copyright 2020 The Ray Authors. | COMMENT |
| LOW | flaml/tune/sample.py | 1 | # Copyright 2020 The Ray Authors. | COMMENT |
| LOW | flaml/tune/space.py | 141 | # for key, domain in space.items(): | COMMENT |
| LOW | flaml/tune/searcher/variant_generator.py | 1 | # Copyright 2020 The Ray Authors. | COMMENT |
| LOW | flaml/tune/searcher/suggestion.py | 1 | # Copyright 2020 The Ray Authors. | COMMENT |
| LOW | flaml/tune/searcher/online_searcher.py | 61 | COMMENT | |
| LOW | flaml/tune/scheduler/trial_scheduler.py | 1 | # Copyright 2020 The Ray Authors. | COMMENT |
| LOW | flaml/onlineml/trial_runner.py | 21 | # The max number of Trial.RUNNING trials is running_budget. | COMMENT |
| LOW | flaml/onlineml/trial_runner.py | 41 | Args: | COMMENT |
| LOW | flaml/onlineml/trial_runner.py | 61 | # It adds candidate trials to the scheduler. It is called inside of the add_trial | COMMENT |
| LOW | flaml/autogen/code_utils.py | 61 | # "content": """In the following conversation, an assistant suggests code and a user is expected to run it. | COMMENT |
| LOW | flaml/autogen/code_utils.py | 81 | COMMENT | |
| LOW | flaml/autogen/code_utils.py | 321 | while container.status != "exited" and time.time() - start_time < timeout: | COMMENT |
| LOW | flaml/autogen/code_utils.py | 541 | # for i, config in enumerate(configs): | COMMENT |
| LOW | …autogen/agentchat/contrib/retrieve_user_proxy_agent.py | 281 | else: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test/test_autovw.py | 42 | logger = logging.getLogger(__name__) | CODE |
| LOW | test/pipeline_tuning_example/tuner/tuner_func.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | test/pipeline_tuning_example/data_prep/data_prep.py | 8 | logger = logging.getLogger(__name__) | CODE |
| LOW | test/tune/test_pytorch_cifar10.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | test/tune/test_tune.py | 23 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/__init__.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/default/suggest.py | 20 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/automl/logger.py | 29 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/automl/ml.py | 38 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/automl/task/time_series_task.py | 26 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/automl/task/generic_task.py | 40 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/automl/spark/__init__.py | 50 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/automl/spark/utils.py | 19 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/analysis.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/trial_runner.py | 15 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/logger.py | 29 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/sample.py | 37 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/space.py | 19 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/searcher/variant_generator.py | 37 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/searcher/suggestion.py | 108 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/searcher/blendsearch.py | 35 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/searcher/online_searcher.py | 11 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/searcher/flow2.py | 35 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/searcher/search_thread.py | 25 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/scheduler/online_scheduler.py | 10 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/tune/spark/__init__.py | 8 | __all__ = ["check_spark", "get_n_cpus", "with_parameters", "broadcast_code"] | CODE |
| LOW | flaml/tune/spark/utils.py | 8 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/onlineml/trial.py | 17 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/onlineml/trial_runner.py | 9 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/onlineml/autovw.py | 16 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/autogen/retrieve_utils.py | 13 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/autogen/agentchat/__init__.py | 7 | __all__ = [ | CODE |
| LOW | flaml/autogen/oai/completion.py | 34 | logger = logging.getLogger(__name__) | CODE |
| LOW | flaml/autogen/oai/__init__.py | 10 | __all__ = [ | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | test/automl/test_custom_hp.py | 83 | # Create a simple regression dataset | COMMENT |
| MEDIUM | test/automl/test_preprocess_api.py | 78 | # Create a simple dataset | COMMENT |
| MEDIUM | test/automl/test_preprocess_api.py | 221 | # Create a simple estimator | COMMENT |
| MEDIUM | test/automl/test_multiclass.py | 202 | # Create a LogisticRegression with specific non-default parameters | COMMENT |
| MEDIUM | test/automl/test_no_overlap.py | 156 | # Create a simple dataset | COMMENT |
| MEDIUM | test/nni/mnist.py | 1 | # This file is copied from NNI project | COMMENT |
| MEDIUM | test/spark/test_0sparkml.py | 347 | # Create a test DataFrame with various types | COMMENT |
| MEDIUM | test/spark/test_0sparkml.py | 375 | # Create a test DataFrame with various types | COMMENT |
| MEDIUM | flaml/automl/time_series/tcn.py | 1 | # This file is adapted from | COMMENT |
| MEDIUM | flaml/automl/spark/metrics.py | 35 | # Create a new column 'prediction' based on the maximum probability value | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | flaml/automl/automl.py | 925 | Preprocess data using task-level preprocessing. This method applies task-level preprocessing transformations to | STRING |
| HIGH | flaml/automl/task/task.py | 216 | Choose an appropriate data split type for this data and task. If split_type is 'auto' then this is determined b | STRING |
| HIGH | flaml/automl/task/task.py | 331 | Determine the estimator class corresponding to the provided name. Args: estimator_name: Name of the | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| HIGH | test/automl/test_regression.py | 0 | xgboostestimator with the logregobj function as the objective function | STRING |
| HIGH | website/docs/Use-Cases/Task-Oriented-AutoML.md | 0 | xgboostestimator with the logregobj function as the objective function | STRING |
| HIGH | website/docs/Examples/AutoML-for-XGBoost.md | 0 | xgboostestimator with the logregobj function as the objective function | STRING |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM⚡ | test/default/test_defaults.py | 282 | # make sure that zero-shot config out of the search space does not degnerate to low cost init config | COMMENT |
| MEDIUM⚡ | test/default/test_defaults.py | 284 | # make sure that the zero-shot config {} is not modified | COMMENT |
| MEDIUM | website/docs/Use-Cases/Task-Oriented-AutoML.md | 669 | `starting_points` is a dictionary or a str to specify the starting hyperparameter config. (1) When it is a dictionary, t | CODE |
| MEDIUM | website/docs/Use-Cases/Zero-Shot-AutoML.md | 90 | ### Combine zero shot AutoML and hyperparameter tuning | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test/automl/test_forecast.py | 626 | CODE | |
| LOW | test/spark/test_tune.py | 33 | CODE | |
| LOW | flaml/automl/automl.py | 1016 | CODE | |
| LOW | flaml/automl/automl.py | 1867 | CODE | |
| LOW | flaml/automl/nlp/huggingface/utils.py | 283 | CODE | |
| LOW | flaml/tune/tune.py | 235 | CODE | |
| LOW | flaml/tune/searcher/blendsearch.py | 44 | CODE | |
| LOW | flaml/tune/searcher/flow2.py | 44 | CODE | |
| LOW | flaml/onlineml/autovw.py | 26 | CODE | |
| LOW | flaml/fabric/mlflow.py | 77 | CODE | |
| LOW | flaml/fabric/mlflow.py | 273 | CODE | |
| LOW | flaml/autogen/retrieve_utils.py | 184 | CODE | |
| LOW | flaml/autogen/agentchat/conversable_agent.py | 46 | CODE | |
| LOW | flaml/autogen/agentchat/user_proxy_agent.py | 19 | CODE |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test/automl/test_training_log.py | 37 | # Check if the training log file is populated. | COMMENT |
| LOW | test/automl/test_python_log.py | 107 | # Check if the log buffer is populated. | COMMENT |
| LOW | flaml/automl/model.py | 1213 | # Check if processing_class parameter is supported (transformers >= 4.44.0) | COMMENT |
| LOW | flaml/automl/data.py | 757 | # Check if timestamp | COMMENT |
| LOW | flaml/automl/data.py | 783 | # Check if timestamp | COMMENT |
| LOW | flaml/tune/spark/utils.py | 165 | # Check if Spark is available | COMMENT |
| LOW | …aml/autogen/agentchat/contrib/math_user_proxy_agent.py | 233 | # Check if there is any print statement | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | test/autogen/oai/test_completion.py | 280 | # a more comprehensive tuning example | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| MEDIUM | flaml/automl/time_series/sklearn.py | 171 | # ---------- | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | test/nlp/test_default.py | 167 | # TODO: implement _test_zero_shot_model | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | flaml/onlineml/trial_runner.py | 115 | # NOTE: This function consists of the following several parts: | COMMENT |
| Severity | File | Line | Snippet | Context |
|---|---|---|---|---|
| LOW | flaml/autogen/code_utils.py | 65 | # When the user needs to run multiple blocks in sequence, make sure to output all the blocks to run in a right order. | COMMENT |