nohup: ignoring input
Loading embeddings from /home/nguyendc/sonnh/embedding-clustering/extract/embeddings_factures_osteopathie_1k_qwen.json...
Loaded 2800 samples with embedding dimension 2048

======================================================================
RUNNING GAUSSIAN MIXTURE MODEL CLUSTERING WITH OPTIMIZED GRID SEARCH
======================================================================
Optimized parameter combinations:
  - n_components: 11 values [2, 3, 4, 5, 6, 8, 10, 11, 14, 17, 20]
  - covariance_types: 2 options ['full', 'diag']
  - reg_covar: 3 values [1e-05, 0.0001, 0.001]
  - n_init: 2 values [1, 5]
  - init_params: 2 options ['kmeans', 'k-means++']
  - max_iter: 2 values [100, 300]
Total combinations: 528 (optimized for speed)
Estimated runtime: 4.4 minutes
This should be much faster...

Progress: 50/528 (9.5%) - Best scores so far: BIC=17260132.61, Silhouette=0.376
Progress: 100/528 (18.9%) - Best scores so far: BIC=17260132.61, Silhouette=0.376
Progress: 150/528 (28.4%) - Best scores so far: BIC=17260132.61, Silhouette=0.376
Progress: 200/528 (37.9%) - Best scores so far: BIC=17260132.61, Silhouette=0.376
Progress: 250/528 (47.3%) - Best scores so far: BIC=17260132.61, Silhouette=0.376
n_components=2, cov=diag, init=kmeans: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089203.91, AIC=13040559.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089203.91, AIC=13040559.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089203.91, AIC=13040559.00, silhouette=0.3697
n_components=2, cov=diag, init=kmeans: BIC=13089203.91, AIC=13040559.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089173.91, AIC=13040529.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089203.91, AIC=13040559.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089203.91, AIC=13040559.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089203.91, AIC=13040559.00, silhouette=0.3697
n_components=2, cov=diag, init=k-means++: BIC=13089203.91, AIC=13040559.00, silhouette=0.3697
n_components=3, cov=diag, init=kmeans: BIC=12693850.34, AIC=12620880.00, silhouette=0.3761
n_components=3, cov=diag, init=kmeans: BIC=12693850.34, AIC=12620880.00, silhouette=0.3761
n_components=3, cov=diag, init=kmeans: BIC=12699627.34, AIC=12626657.00, silhouette=0.3761
n_components=3, cov=diag, init=kmeans: BIC=12699627.34, AIC=12626657.00, silhouette=0.3761
n_components=3, cov=diag, init=kmeans: BIC=12718245.34, AIC=12645275.00, silhouette=0.3761
n_components=3, cov=diag, init=kmeans: BIC=12718245.34, AIC=12645275.00, silhouette=0.3761
Progress: 300/528 (56.8%) - Best scores so far: BIC=11770626.34, Silhouette=0.376
n_components=4, cov=diag, init=kmeans: BIC=11525150.76, AIC=11427855.00, silhouette=0.3090
n_components=4, cov=diag, init=kmeans: BIC=11525150.76, AIC=11427855.00, silhouette=0.3090
n_components=4, cov=diag, init=kmeans: BIC=11530927.76, AIC=11433632.00, silhouette=0.3090
n_components=4, cov=diag, init=kmeans: BIC=11530927.76, AIC=11433632.00, silhouette=0.3090
n_components=4, cov=diag, init=kmeans: BIC=11549555.76, AIC=11452260.00, silhouette=0.3090
n_components=4, cov=diag, init=kmeans: BIC=11549555.76, AIC=11452260.00, silhouette=0.3090
n_components=5, cov=diag, init=kmeans: BIC=10641753.18, AIC=10520132.00, silhouette=0.3119
n_components=5, cov=diag, init=kmeans: BIC=10641753.18, AIC=10520132.00, silhouette=0.3119
n_components=5, cov=diag, init=kmeans: BIC=10647529.18, AIC=10525908.00, silhouette=0.3119
n_components=5, cov=diag, init=kmeans: BIC=10647529.18, AIC=10525908.00, silhouette=0.3119
n_components=5, cov=diag, init=kmeans: BIC=10666196.18, AIC=10544575.00, silhouette=0.3119
n_components=5, cov=diag, init=kmeans: BIC=10666196.18, AIC=10544575.00, silhouette=0.3119
Progress: 350/528 (66.3%) - Best scores so far: BIC=9931250.18, Silhouette=0.376
Progress: 400/528 (75.8%) - Best scores so far: BIC=8401628.46, Silhouette=0.376
Progress: 450/528 (85.2%) - Best scores so far: BIC=7579813.73, Silhouette=0.376
Progress: 500/528 (94.7%) - Best scores so far: BIC=6988291.27, Silhouette=0.376
Progress: 528/528 (100.0%) - Best scores so far: BIC=6849987.05, Silhouette=0.376

======================================================================
GAUSSIAN MIXTURE MODEL GRID SEARCH ANALYSIS
======================================================================
Total parameter combinations tested: 413
Combinations with valid clustering: 413

Model Selection Metrics:
Best BIC score: 6849987.05
Best AIC score: -11119584.00
Best Log-Likelihood: 6594.97

Clustering Quality Metrics:
Best silhouette score: 0.3761
Mean silhouette score: 0.2317
Best Calinski-Harabasz score: 1331.69
Best Davies-Bouldin score: 0.7860

Top 5 results by BIC (lower is better):
  n_comp=20, cov=diag: BIC=6849987.05, AIC=6363484.50
  n_comp=20, cov=diag: BIC=6849987.05, AIC=6363484.50
  n_comp=20, cov=diag: BIC=6849987.05, AIC=6363484.50
  n_comp=20, cov=diag: BIC=6849987.05, AIC=6363484.50
  n_comp=20, cov=diag: BIC=6855879.05, AIC=6369376.50

Top 5 results by AIC (lower is better):
  n_comp=4, cov=full: BIC=38759701.15, AIC=-11119584.00
  n_comp=4, cov=full: BIC=38759701.15, AIC=-11119584.00
  n_comp=3, cov=full: BIC=26462676.38, AIC=-10946786.00
  n_comp=3, cov=full: BIC=26462676.38, AIC=-10946786.00
  n_comp=5, cov=full: BIC=54230057.92, AIC=-8119050.00

Top 5 results by Silhouette Score:
  n_comp=3, cov=diag: silhouette=0.3761
  n_comp=3, cov=diag: silhouette=0.3761
  n_comp=3, cov=diag: silhouette=0.3761
  n_comp=3, cov=diag: silhouette=0.3761
  n_comp=3, cov=diag: silhouette=0.3761

Component count analysis (top 10 by BIC):
  20.0 components: BIC=6849987.05, AIC=6363484.50, silhouette=0.1770
  17.0 components: BIC=6988291.27, AIC=6574765.00, silhouette=0.2085
  14.0 components: BIC=7179637.00, AIC=6839087.00, silhouette=0.2119
  11.0 components: BIC=7579813.73, AIC=7312240.00, silhouette=0.2577
  10.0 components: BIC=7737961.30, AIC=7494713.00, silhouette=0.2863
  8.0 components: BIC=8401628.46, AIC=1051428.00, silhouette=0.2748
  6.0 components: BIC=9102218.61, AIC=-6065602.00, silhouette=0.2707
  5.0 components: BIC=9931250.18, AIC=-8119050.00, silhouette=0.3163
  4.0 components: BIC=10865268.76, AIC=-11119584.00, silhouette=0.3110
  3.0 components: BIC=11686081.34, AIC=-10946786.00, silhouette=0.3761

📁 SAVING DETAILED RESULTS...
==============================
Detailed grid search results saved to: gmm_grid_search_detailed_20250801_015245.json
Grid search summary CSV saved to: gmm_grid_search_summary_20250801_015245.csv

Best GMM result by BIC:
Parameters: {'n_components': 20, 'covariance_type': 'diag', 'reg_covar': 1e-05, 'n_init': 1, 'init_params': 'kmeans', 'max_iter': 100}
BIC score: 6849987.05

Best GMM result by AIC:
Parameters: {'n_components': 4, 'covariance_type': 'full', 'reg_covar': 0.0001, 'n_init': 5, 'init_params': 'kmeans', 'max_iter': 100}
AIC score: -11119584.00

Best GMM result by Silhouette:
Parameters: {'n_components': 3, 'covariance_type': 'diag', 'reg_covar': 1e-05, 'n_init': 1, 'init_params': 'kmeans', 'max_iter': 100}
Silhouette score: 0.3761
Visualization saved as 'gmm_clustering_results.png'
Final clustering results (bic) saved to: gmm_final_results_bic_20250801_015247.json
Traceback (most recent call last):
  File "/home/nguyendc/sonnh/embedding-clustering/cluster/gmm_extensive.py", line 646, in <module>
    main()
  File "/home/nguyendc/sonnh/embedding-clustering/cluster/gmm_extensive.py", line 640, in main
    clustering.save_clustering_results(results)
  File "/home/nguyendc/sonnh/embedding-clustering/cluster/gmm_extensive.py", line 614, in save_clustering_results
    json.dump({
  File "/home/nguyendc/miniconda3/envs/cluster/lib/python3.10/json/__init__.py", line 179, in dump
    for chunk in iterable:
  File "/home/nguyendc/miniconda3/envs/cluster/lib/python3.10/json/encoder.py", line 431, in _iterencode
    yield from _iterencode_dict(o, _current_indent_level)
  File "/home/nguyendc/miniconda3/envs/cluster/lib/python3.10/json/encoder.py", line 405, in _iterencode_dict
    yield from chunks
  File "/home/nguyendc/miniconda3/envs/cluster/lib/python3.10/json/encoder.py", line 438, in _iterencode
    o = _default(o)
  File "/home/nguyendc/miniconda3/envs/cluster/lib/python3.10/json/encoder.py", line 179, in default
    raise TypeError(f'Object of type {o.__class__.__name__} '
TypeError: Object of type float32 is not JSON serializable