← Back to the catalog
Publicraw reproducible

ROD Raman native-axis 2023-point mineral subset

rod · Raman

ROD Raman native-axis 2023-point mineral subset. v2.0 standardized NIRS package: 1 spectral source(s), 4 declared target(s). Auto-generated from dataset_card.json (verify before publication).

nirv2rod
48
samples
2,023
wavelengths
1
sources
4
targets
21
metadata
Raman
family

Dataset property explorer

Mean profile risk0.59
Highest axisArtefacts locaux · 1.00
Diagnostics8
Sources profiled1
ROD Raman native-axis 2023-point mineral subset property profile0.250.50.751integritynoiseartefactsbaselinePCA outliersreferencerepeatabilitystructureROD Raman native-axis 2023-point mineral subset profileintegrity: 0.00noise: 0.01artefacts: 1.00baseline: 0.74PCA outliers: 1.00reference: 1.00repeatability: 0.00structure: 1.00ROD Raman nativ…0 center · 1 outer ring · outward = stronger anomaly / heterogeneity signal

Profile axes

Intégrité0.00
Artefacts locaux1.00
Bruit0.01
Outliers PCA1.00
Distance à la référence1.00
Répétabilité0.00
Baseline / forme0.74
Structure multi-régimes1.00
Diagnostic hypotheses00.250.50.751hypothesis scoreSplice / raccord détecteursSplice / raccord détecteurs: 0.940.94Signature VERA25-likeSignature VERA25-like: 0.790.79Erreur calibration / référenc…Erreur calibration / référence blanche: 0.790.79Erreur interpolation / réécha…Erreur interpolation / rééchantillonnage: 0.780.78Fond différentFond différent: 0.750.75Spectre hors domaine valideSpectre hors domaine valide: 0.740.74Dataset multi-régimesDataset multi-régimes: 0.720.72Différence de sonde / géométr…Différence de sonde / géométrie: 0.680.68
DiagnosticScoreForceSignauxInterprétation probable
Splice / raccord détecteursX0.94fortePCA Q 1.00, Spike rate 1.00, Jump rate 1.00Rupture aux jonctions de détecteurs, calibration locale ou sonde différente.
Signature VERA25-likeX0.79fortePCA Q 1.00, Mahalanobis / T2 1.00, Spike rate 1.00Combinaison possible changement de sonde + splice, amplifiée par géométrie, fond ou calibration.
Erreur calibration / référence blancheX0.79fortePCA Q 1.00, Mahalanobis / T2 1.00, RMS/SAM référence 1.00Décalage systématique entre campagnes, instruments ou référence blanche.
Erreur interpolation / rééchantillonnageX0.78fortePCA Q 1.00, Spike rate 1.00, Jump rate 1.00Artefacts numériques ou traitement spectral incorrect.
Fond différentX0.75fortePCA Q 1.00, Mahalanobis / T2 1.00, RMS/SAM référence 1.00Effet systématique du support, blanc/noir, transflectance ou environnement de mesure.
Spectre hors domaine valideX0.74forteMahalanobis / T2 1.00, RMS/SAM référence 1.00, Structure PCA 1.00Variété, espèce, lot ou condition différente mais physiquement plausible.
Dataset multi-régimesX0.72forteStructure PCA 1.00, RMS/SAM référence 1.00, PCA Q 1.00Mélange de campagnes, opérateurs, lots, setups ou sous-populations spectrales.
Différence de sonde / géométrieX0.68moyennePCA Q 1.00, Mahalanobis / T2 1.00, RMS/SAM référence 1.00Modification de l'illumination, collecte, angle ou distance sonde-échantillon.

Spectral sources

ROD native Raman axis group

X · Raman · ROD source metadata, not consistently specified
ROD native Raman axis group spectra-1,00001,0002,0003,0004,00005001,0001,5002,0002,500q05-q95 envelopeq25-q75 envelopemedian spectrummedianq25–q75q05–q95wavelength / cm-150.506cm-1 — median 145.9 (q25–q75 49.22–318.6)64.969cm-1 — median 112.8 (q25–q75 36.22–331.4)78.469cm-1 — median 100.7 (q25–q75 29.44–325.6)92.932cm-1 — median 115 (q25–q75 30.21–359.1)106.43cm-1 — median 99.89 (q25–q75 28.56–527.8)120.89cm-1 — median 120.8 (q25–q75 25.52–605.5)134.39cm-1 — median 125.9 (q25–q75 37.92–431.3)148.86cm-1 — median 142.7 (q25–q75 27.18–386)162.36cm-1 — median 140.3 (q25–q75 20.88–339.7)176.82cm-1 — median 105.8 (q25–q75 23.62–214.3)190.32cm-1 — median 88.64 (q25–q75 19.39–246)204.78cm-1 — median 71.02 (q25–q75 24.17–208.4)219.25cm-1 — median 50.77 (q25–q75 18.06–151)232.75cm-1 — median 45.07 (q25–q75 6.602–131.1)247.21cm-1 — median 38.32 (q25–q75 6.539–108.6)260.71cm-1 — median 39.69 (q25–q75 8.388–100.7)275.17cm-1 — median 39.97 (q25–q75 11.38–110.6)288.67cm-1 — median 34.18 (q25–q75 10.05–134.7)303.13cm-1 — median 30.32 (q25–q75 11.44–275.1)316.63cm-1 — median 26.24 (q25–q75 12.38–209.6)331.1cm-1 — median 25.41 (q25–q75 10.71–262.8)344.6cm-1 — median 23.01 (q25–q75 13.32–260.5)359.06cm-1 — median 23.56 (q25–q75 10.28–262.9)373.52cm-1 — median 19.45 (q25–q75 9.681–194.1)387.02cm-1 — median 16.98 (q25–q75 8.204–187.3)401.49cm-1 — median 16.8 (q25–q75 8.272–158.3)414.99cm-1 — median 13.8 (q25–q75 7.65–158.4)429.45cm-1 — median 13.58 (q25–q75 7.217–130.4)442.95cm-1 — median 14.5 (q25–q75 5.675–88.8)457.41cm-1 — median 14.15 (q25–q75 6.694–186.2)470.91cm-1 — median 16.09 (q25–q75 6.558–191.8)485.38cm-1 — median 9.834 (q25–q75 4.624–128.3)498.87cm-1 — median 6.862 (q25–q75 3.298–103.8)513.34cm-1 — median 4.305 (q25–q75 2.375–21.67)527.8cm-1 — median 5.986 (q25–q75 3.636–18.55)541.3cm-1 — median 4.142 (q25–q75 1.442–20.21)555.76cm-1 — median 2.958 (q25–q75 0.6946–52.06)569.26cm-1 — median 1.871 (q25–q75 -0.3672–30.49)583.73cm-1 — median 1.506 (q25–q75 0.3097–29.1)597.23cm-1 — median 3 (q25–q75 0.3946–34.99)611.69cm-1 — median 3.743 (q25–q75 0.9042–48.7)625.19cm-1 — median 1.991 (q25–q75 0.4992–48.72)639.65cm-1 — median 2.19 (q25–q75 0.001815–34.88)654.12cm-1 — median 3.206 (q25–q75 -0.08718–45.74)667.62cm-1 — median 2.474 (q25–q75 0.2537–33.16)682.08cm-1 — median 2.329 (q25–q75 -0.08551–24.35)695.58cm-1 — median 2.534 (q25–q75 0.01612–30.12)710.04cm-1 — median 3.16 (q25–q75 -0.04448–20.76)723.54cm-1 — median 4.992 (q25–q75 0.06498–25.07)738cm-1 — median 6.34 (q25–q75 1.182–28)751.5cm-1 — median 4.17 (q25–q75 1.3–15.14)765.97cm-1 — median 5.454 (q25–q75 2.536–12.1)779.47cm-1 — median 4.249 (q25–q75 1.576–13.17)793.93cm-1 — median 4.532 (q25–q75 1.779–14.81)808.39cm-1 — median 4.319 (q25–q75 1.261–17.18)821.89cm-1 — median 4.649 (q25–q75 1.06–28.41)836.36cm-1 — median 7.149 (q25–q75 3.004–19.93)849.86cm-1 — median 6.938 (q25–q75 1.138–17)864.32cm-1 — median 9.056 (q25–q75 1.73–19.85)877.82cm-1 — median 11.31 (q25–q75 1.521–31.09)892.28cm-1 — median 8.312 (q25–q75 0.6986–19)905.78cm-1 — median 4.908 (q25–q75 -0.1037–13.84)920.24cm-1 — median 4.761 (q25–q75 -0.293–14.21)933.74cm-1 — median 5.331 (q25–q75 -0.07318–16.62)948.21cm-1 — median 7.322 (q25–q75 0.8619–18.7)962.67cm-1 — median 6.842 (q25–q75 0.3322–22.46)976.17cm-1 — median 12.93 (q25–q75 1.049–24.64)990.63cm-1 — median 12.02 (q25–q75 1.285–31.99)1004.1cm-1 — median 12.17 (q25–q75 0.8741–30.03)1018.6cm-1 — median 12.54 (q25–q75 1.538–26.92)1032.1cm-1 — median 14.43 (q25–q75 2.957–26.97)1046.6cm-1 — median 10.26 (q25–q75 1.914–28.66)1060.1cm-1 — median 10.64 (q25–q75 2.491–30.28)1074.5cm-1 — median 12.23 (q25–q75 1.227–28.86)1088cm-1 — median 12.62 (q25–q75 2.18–31.28)1102.5cm-1 — median 12.02 (q25–q75 3.304–37.49)1116.9cm-1 — median 11.56 (q25–q75 2.613–39.4)1130.4cm-1 — median 12.4 (q25–q75 2.663–40.14)1144.9cm-1 — median 12.49 (q25–q75 3.756–40.49)1158.4cm-1 — median 13.33 (q25–q75 3.996–40.72)1172.9cm-1 — median 15.01 (q25–q75 4.904–41.57)1186.4cm-1 — median 15.43 (q25–q75 3.361–39.67)1200.8cm-1 — median 17.33 (q25–q75 3.212–43.41)1214.3cm-1 — median 16.94 (q25–q75 2.462–46.29)1228.8cm-1 — median 16.54 (q25–q75 3.002–44.81)1242.3cm-1 — median 16.67 (q25–q75 2.343–47.96)1256.8cm-1 — median 16.5 (q25–q75 3.45–48.35)1271.2cm-1 — median 18.08 (q25–q75 3.642–51.53)1284.7cm-1 — median 16.65 (q25–q75 2.392–51.22)1299.2cm-1 — median 17.13 (q25–q75 3.288–50.47)1312.7cm-1 — median 18.62 (q25–q75 4.205–48.58)1327.2cm-1 — median 15.83 (q25–q75 2.883–45.44)1340.7cm-1 — median 15.74 (q25–q75 5.118–47.37)1355.1cm-1 — median 22.67 (q25–q75 7.864–49.95)1368.6cm-1 — median 23 (q25–q75 5.855–52.59)1383.1cm-1 — median 26.13 (q25–q75 5.218–51.48)1396.6cm-1 — median 24.78 (q25–q75 3.152–49.9)1411cm-1 — median 23.79 (q25–q75 1.748–47.23)1425.5cm-1 — median 22.16 (q25–q75 1.309–47.04)1439cm-1 — median 24.48 (q25–q75 1.747–48.06)1453.5cm-1 — median 25.01 (q25–q75 1.343–45.29)1467cm-1 — median 22.14 (q25–q75 0.9466–43.06)1481.4cm-1 — median 22.06 (q25–q75 1.275–43.39)1494.9cm-1 — median 20.74 (q25–q75 0.8437–40.41)1509.4cm-1 — median 21.64 (q25–q75 1.686–39.85)1522.9cm-1 — median 20.19 (q25–q75 0.2562–37.45)1537.4cm-1 — median 18.81 (q25–q75 1.346–35.44)1551.8cm-1 — median 19.26 (q25–q75 2.625–35.8)1565.3cm-1 — median 17.83 (q25–q75 2.333–32.59)1579.8cm-1 — median 15.22 (q25–q75 1.156–29.22)1593.3cm-1 — median 16.92 (q25–q75 3.573–30.09)1607.7cm-1 — median 14.34 (q25–q75 0.7449–26.95)1621.2cm-1 — median 11.34 (q25–q75 1.597–22.25)1635.7cm-1 — median 9.754 (q25–q75 0.2321–19.56)1649.2cm-1 — median 8.214 (q25–q75 1.474–18.13)1663.7cm-1 — median 7.123 (q25–q75 0.9865–16.14)1677.2cm-1 — median 5.924 (q25–q75 0.1607–13.37)1691.6cm-1 — median 4.91 (q25–q75 -0.368–10.91)1706.1cm-1 — median 4.485 (q25–q75 -0.5139–9.046)1719.6cm-1 — median 2.984 (q25–q75 -0.2858–7.516)1734.1cm-1 — median 1.984 (q25–q75 -0.6247–6.187)1747.6cm-1 — median 1.386 (q25–q75 -0.2723–4.305)1762cm-1 — median 2.15 (q25–q75 0.4136–4.099)1775.5cm-1 — median 1.021 (q25–q75 -0.2429–2.744)1790cm-1 — median -0.05564 (q25–q75 -0.9991–1.462)1803.5cm-1 — median 0.8439 (q25–q75 -0.1287–2.46)1817.9cm-1 — median 0.5024 (q25–q75 -0.5057–1.542)1831.4cm-1 — median 0.3534 (q25–q75 -0.8577–1.021)1845.9cm-1 — median -0.1736 (q25–q75 -1.031–1.17)1860.4cm-1 — median 0.2275 (q25–q75 -1.018–1.887)1873.9cm-1 — median 0.5484 (q25–q75 -0.39–2.538)1888.3cm-1 — median 1.205 (q25–q75 -0.4325–4.131)1901.8cm-1 — median 2.483 (q25–q75 0.006215–5.199)1916.3cm-1 — median 3.915 (q25–q75 0.5689–6.279)1929.8cm-1 — median 5.105 (q25–q75 1.299–8.936)1944.3cm-1 — median 6.056 (q25–q75 0.9948–10.87)1957.8cm-1 — median 6.354 (q25–q75 1.827–12.47)1972.2cm-1 — median 6.806 (q25–q75 1.301–13.49)1985.7cm-1 — median 8.621 (q25–q75 1.251–16.79)2000.2cm-1 — median 9.172 (q25–q75 0.9207–17.61)

Sampling

Wavelengths2,023
Axis range50.51–2000 cm-1
Mean spacing0.964 cm-1
Griduniform
Observations48

Signal & quality

Value range-50.4 – 1.76e+04
Mean range9.72 – 850
Mean level146.5
Area2.854e+05
PTP840.6
Noise RMS0.24239
SNR6.1e+02
SNR dB6e+01 dB
Dynamic range841
Smoothness12.6
Saturated0.0%
X-outliers21

Integrity & artefacts

NaN ratio0.00%
Inf count0
Zero ratio0.01%
Spike count3,267
Spike rate3.37%
Jump count6,987
Jump rate7.20%
Clip fraction0.00%

Shape & reference

Baseline slope-310.56
Curvature RMS7.4811
D1 RMS18.303
RMS to mean206.38
RMS p951155.6
SAM to mean1.0788
SAM p951.3406
Affine offset p95312.43
Affine gain p95 Δ3.9149
Affine residual p95910.04
Xcorr lag p9550

Outliers & repeatability

PCA Q p95/median14
Hotelling T2 p95/median79
Mahalanobis H p95/median8.9
Repeat groups0

Dimensionality (PCA)

Effective rank4.7
PCs → 95% var8
PCs → 99% var15
Top-10 cum. var97.4%
Computed metric scores 29worst 1.00
FamilleMétrique calculéeValeurScoreNiveauInterprétation datasetCauses typiquesCalcul / scoring
Intégrité des donnéesNaN ratiointegrity.nan_ratio0%0.00faibleSpectre completErreur acquisition/exportcount(isnan(X)) / X.sizealert = min(1, nan_ratio / 0.05)
Intégrité des donnéesInf countintegrity.inf_count00.00faibleNormalCalculs invalidescount(isinf(X))alert = min(1, inf_count / 1)
Intégrité des donnéesZero ratiointegrity.zero_ratio0.00618%0.00faibleNormalExport, saturationcount(X == 0) / count(finite X)alert = min(1, zero_ratio / 0.05)
Amplitude globaleMean reflectanceamplitude.mean_reflectance146.470.74fortValeur atypique: Trop clair / fond visible ou Trop sombreFond, géométriemean(X finite)alert reuses baseline/shape drift because absolute reflectance ranges are technology-dependent
Amplitude globaleArea under curveamplitude.area_under_curve2.8539e+050.74fortValeur atypique: Différence d'éclairement ou NormalDistance sondetrapezoid(mean_spectrum, spectral_axis)alert reuses baseline/shape drift because area scale depends on axis and units
Amplitude globalePeak-to-peak (PTP)amplitude.peak_to_peak840.640.00faibleVariabilité forteSaturationmax(mean_spectrum) - min(mean_spectrum)alert increases when dynamic range is abnormally flat
Amplitude globaleVarianceamplitude.variance4.7004e+050.00faibleNormal ou hétérogèneMauvais contactvar(X finite)alert increases when variance/dynamic range is abnormally flat
BruitNoise RMSnoise.noise_rms0.242390.01faibleStableLampe, détecteurmedian MAD(second derivative) * 1.4826 / sqrt(6)alert = noise_rms / signal_scale, saturated at 5%
BruitSNRnoise.snr606.780.00faibleBon signalAcquisitionmean(abs(X)) / noise_rmsalert decreases with SNR dB; >=40 dB is treated as low alert
BruitBandwise SNRnoise.bandwise_snr_min23.3180.22faibleZone fiableDétecteurmin(abs(mean_spectrum) / local second-derivative noise)alert decreases with worst-band SNR dB; >=35 dB is treated as low alert
Artefacts locauxSpike countartefacts.spike_count3,2671.00fortArtefactsCosmic rays, splicecount robust outliers in second derivativealert follows spike_rate, saturated at 1%
Artefacts locauxSpike rateartefacts.spike_rate3.37%1.00fortSpectre suspectInterpolationspike_count / (n_samples * (n_features - 2))alert = min(1, spike_rate / 0.01)
Artefacts locauxJump countartefacts.jump_count6,9871.00fortRaccord détecteurSplicecount robust outliers in first derivativealert follows jump_rate, saturated at 1%
Artefacts locauxJump rateartefacts.jump_rate7.2%1.00fortProblème spectralCalibrationjump_count / (n_samples * (n_features - 1))alert = min(1, jump_rate / 0.01)
Artefacts locauxClip fractionartefacts.clip_fraction0.00206%0.00faibleNormalDétecteur saturéfraction of finite cells equal to repeated min/max extremaalert = min(1, clip_fraction / 0.01)
Forme spectraleBaseline slopeshape.baseline_slope-310.560.74fortDériveÉclairementlinear slope of mean_spectrum over normalized axisalert = abs(slope / signal_scale), saturated at 0.5
Forme spectraleCurvature RMSshape.curvature_rms7.48110.89fortForme inhabituelleFond, splicemedian RMS(second derivative per spectrum)alert = curvature_rms / signal_scale, saturated at 1%
Forme spectraleD1 RMSshape.d1_rms18.3030.44moyenSpectre structuréBiologie ou artefactmedian RMS(first derivative per spectrum)alert = d1_rms / signal_scale, saturated at 5%
Outliers multivariésPCA Q (SPE)outliers.pca_q_ratio14.4231.00fortSpectre atypiqueArtefact, mélangep95(Q/SPE residual) / median(Q/SPE residual)alert = min(1, pca_q_ratio / 8)
Outliers multivariésHotelling T²outliers.hotelling_t2_ratio79.411.00fortExtrême mais cohérentVariabilité naturellep95(Hotelling T2) / median(Hotelling T2)alert = min(1, hotelling_t2_ratio / 8)
Outliers multivariésMahalanobis Houtliers.mahalanobis_h_ratio8.91431.00fortOutlier globalDomaine différentp95(sqrt(T2)) / median(sqrt(T2))alert = min(1, mahalanobis_h_ratio / 4)
Comparaison à référenceRMS to mean spectrumreference.rms_to_mean_spectrum_p951155.61.00fortSpectre différentDomain shiftp95 RMS distance to dataset mean spectrumalert = RMS_p95 / signal_scale, saturated at 25%
Comparaison à référenceSpectral Angle Mapper (SAM)reference.sam_to_mean_spectrum_p951.34061.00fortForme différenteFond, géométriep95 spectral angle to dataset mean spectrumalert = min(1, SAM_p95 / 0.35 rad)
RépétabilitéRMS intra-IDrepeatability.rms_intra_id—0.00faibleStablePositionnementmedian RMS distance to repeated-sample centroidalert = RMS_intra_ID / signal_scale, saturated at 10%
RépétabilitéSAM intra-IDrepeatability.sam_intra_id—0.00faibleStableAcquisitionmedian SAM to repeated-sample centroidalert = min(1, SAM_intra_ID / 0.15 rad)
RépétabilitéCV intra-IDrepeatability.cv_intra_id—0.00faibleStableOpérateurmedian within-ID band CValert = min(1, CV_intra_ID / 0.25)
Structure du datasetPCA score densitystructure.pca_score_density0.000466941.00fortSous-populationsLots différents1 / median kNN distance in PCA score spacealert follows density_cv/profile structure complexity, not raw density alone
Structure du datasetLocal Outlier Factor (LOF)structure.local_outlier_factor_p9522.5241.00fortSpectre isoléCas raresp95 approximate LOF from PCA-score kNN distancesalert = min(1, max(0, LOF_p95 - 1) / 2)
Structure du datasetIsolation Forest scorestructure.isolation_forest_score_p950.639561.00fortSpectre atypiqueDiverses causesp95 IsolationForest anomaly score on PCA scoresalert follows structure complexity; raw score is implementation-dependent
X PCA score plot-50,000050,000100,000150,000200,000-60,000-40,000-20,000020,000PC1 -4186 · PC2 6935PC1 -2897 · PC2 -1.678e+04PC1 -3987 · PC2 5064PC1 -4220 · PC2 7812PC1 -2886 · PC2 6084PC1 -3438 · PC2 1374PC1 -4093 · PC2 6933PC1 -3610 · PC2 7134PC1 -1428 · PC2 -4.267e+04PC1 -2690 · PC2 -1.165e+04PC1 -4186 · PC2 6935PC1 -4225 · PC2 7757PC1 -3775 · PC2 5005PC1 -4193 · PC2 7758PC1 -3680 · PC2 395.9PC1 -3546 · PC2 -2609PC1 740.6 · PC2 4838PC1 -4250 · PC2 7787PC1 -4259 · PC2 7750PC1 -4245 · PC2 7848PC1 -2637 · PC2 4010PC1 -3622 · PC2 5132PC1 -4304 · PC2 7583PC1 -3678 · PC2 7048PC1 -3683 · PC2 6747PC1 -3735 · PC2 -3591PC1 -3768 · PC2 6850PC1 -3312 · PC2 4515PC1 -4265 · PC2 7884PC1 -3382 · PC2 7256PC1 -3017 · PC2 1354PC1 -3158 · PC2 5418PC1 -1603 · PC2 -9066PC1 -856.3 · PC2 -4.743e+04PC1 1.54e+05 · PC2 3028PC1 -3174 · PC2 3784PC1 -2777 · PC2 -2.613e+04PC1 402 · PC2 -4.058e+04PC1 -4285 · PC2 7581PC1 -3219 · PC2 3405PC1 -3602 · PC2 7568PC1 -2898 · PC2 -1.096e+04PC1 -4108 · PC2 -4267PC1 -4295 · PC2 6991PC1 -384.1 · PC2 3031PC1 -4244 · PC2 7871PC1 -3460 · PC2 5444PC1 -3866 · PC2 5819PC1 (55.8%)PC2 (19.5%)48 scores
PCA explained variance0%25%50%75%100%PC1: 55.8% (cumulative 55.8%)1PC2: 19.5% (cumulative 75.2%)2PC3: 6.4% (cumulative 81.6%)3PC4: 5.4% (cumulative 86.9%)4PC5: 3.6% (cumulative 90.5%)5PC6: 2.6% (cumulative 93.1%)6PC7: 1.5% (cumulative 94.6%)7PC8: 1.3% (cumulative 95.9%)8PC9: 0.8% (cumulative 96.8%)9PC10: 0.6% (cumulative 97.4%)10cumulative explained variancePC variancecumulativeprincipal component · cumulative (dashed)

Metric interpretation reference

Metric catalog 29
FamilleMétriqueCe qu’elle détecteForte valeur =Faible valeur =Causes typiquesCalcul / score
Intégrité des donnéesNaN ratioDonnées manquantesSpectre corrompuSpectre completErreur acquisition/exportcount(isnan(X)) / X.sizealert = min(1, nan_ratio / 0.05)
Intégrité des donnéesInf countValeurs infiniesCorruptionNormalCalculs invalidescount(isinf(X))alert = min(1, inf_count / 1)
Intégrité des donnéesZero ratioColonnes ou cellules nullesSpectre tronquéNormalExport, saturationcount(X == 0) / count(finite X)alert = min(1, zero_ratio / 0.05)
Amplitude globaleMean reflectanceNiveau moyenTrop clair / fond visibleTrop sombreFond, géométriemean(X finite)alert reuses baseline/shape drift because absolute reflectance ranges are technology-dependent
Amplitude globaleArea under curveIntensité globaleDifférence d'éclairementNormalDistance sondetrapezoid(mean_spectrum, spectral_axis)alert reuses baseline/shape drift because area scale depends on axis and units
Amplitude globalePeak-to-peak (PTP)DynamiqueVariabilité forteSpectre platSaturationmax(mean_spectrum) - min(mean_spectrum)alert increases when dynamic range is abnormally flat
Amplitude globaleVarianceVariabilité spectraleNormal ou hétérogèneSpectre platMauvais contactvar(X finite)alert increases when variance/dynamic range is abnormally flat
BruitNoise RMSBruit haute fréquenceBruitéStableLampe, détecteurmedian MAD(second derivative) * 1.4826 / sqrt(6)alert = noise_rms / signal_scale, saturated at 5%
BruitSNRQualité signalBon signalMauvais signalAcquisitionmean(abs(X)) / noise_rmsalert decreases with SNR dB; >=40 dB is treated as low alert
BruitBandwise SNRBruit localiséZone fiableZone problématiqueDétecteurmin(abs(mean_spectrum) / local second-derivative noise)alert decreases with worst-band SNR dB; >=35 dB is treated as low alert
Artefacts locauxSpike countPics étroitsArtefactsSpectre propreCosmic rays, splicecount robust outliers in second derivativealert follows spike_rate, saturated at 1%
Artefacts locauxSpike rateDensité de picsSpectre suspectNormalInterpolationspike_count / (n_samples * (n_features - 2))alert = min(1, spike_rate / 0.01)
Artefacts locauxJump countDiscontinuitésRaccord détecteurContinuSplicecount robust outliers in first derivativealert follows jump_rate, saturated at 1%
Artefacts locauxJump rateFréquence de sautsProblème spectralNormalCalibrationjump_count / (n_samples * (n_features - 1))alert = min(1, jump_rate / 0.01)
Artefacts locauxClip fractionSaturationClippingNormalDétecteur saturéfraction of finite cells equal to repeated min/max extremaalert = min(1, clip_fraction / 0.01)
Forme spectraleBaseline slopePente globaleDériveStableÉclairementlinear slope of mean_spectrum over normalized axisalert = abs(slope / signal_scale), saturated at 0.5
Forme spectraleCurvature RMSCourbureForme inhabituelleLisseFond, splicemedian RMS(second derivative per spectrum)alert = curvature_rms / signal_scale, saturated at 1%
Forme spectraleD1 RMSVariabilité localeSpectre structuréPlatBiologie ou artefactmedian RMS(first derivative per spectrum)alert = d1_rms / signal_scale, saturated at 5%
Outliers multivariésPCA Q (SPE)Non expliqué par PCASpectre atypiqueConformeArtefact, mélangep95(Q/SPE residual) / median(Q/SPE residual)alert = min(1, pca_q_ratio / 8)
Outliers multivariésHotelling T²Extrême dans PCAExtrême mais cohérentCentralVariabilité naturellep95(Hotelling T2) / median(Hotelling T2)alert = min(1, hotelling_t2_ratio / 8)
Outliers multivariésMahalanobis HDistance au nuageOutlier globalPopulation normaleDomaine différentp95(sqrt(T2)) / median(sqrt(T2))alert = min(1, mahalanobis_h_ratio / 4)
Comparaison à référenceRMS to mean spectrumDistance moyenneSpectre différentTypiqueDomain shiftp95 RMS distance to dataset mean spectrumalert = RMS_p95 / signal_scale, saturated at 25%
Comparaison à référenceSpectral Angle Mapper (SAM)Différence de formeForme différenteSimilaireFond, géométriep95 spectral angle to dataset mean spectrumalert = min(1, SAM_p95 / 0.35 rad)
RépétabilitéRMS intra-IDReproductibilitéMauvaise répétabilitéStablePositionnementmedian RMS distance to repeated-sample centroidalert = RMS_intra_ID / signal_scale, saturated at 10%
RépétabilitéSAM intra-IDVariation de formeInstableStableAcquisitionmedian SAM to repeated-sample centroidalert = min(1, SAM_intra_ID / 0.15 rad)
RépétabilitéCV intra-IDVariabilité interneMauvais contrôleStableOpérateurmedian within-ID band CValert = min(1, CV_intra_ID / 0.25)
Structure du datasetPCA score densityClustersSous-populationsHomogèneLots différents1 / median kNN distance in PCA score spacealert follows density_cv/profile structure complexity, not raw density alone
Structure du datasetLocal Outlier Factor (LOF)Anomalie localeSpectre isoléPopulation normaleCas raresp95 approximate LOF from PCA-score kNN distancesalert = min(1, max(0, LOF_p95 - 1) / 2)
Structure du datasetIsolation Forest scoreAnomalie globaleSpectre atypiqueNormalDiverses causesp95 IsolationForest anomaly score on PCA scoresalert follows structure complexity; raw score is implementation-dependent
Technology-specific extensions
TechnologieAdaptations / métriquesAnomalies cibléesCommentaire pratique
UV-Vis 300-1000 nmBaseline, pente globale, dérive aux bords 300-350 et 900-1000; métriques par zonesLumière parasite, mauvais blanc, saturation, faible signal aux extrémitésLes bords sont souvent instables; calculer aussi des scores edge/middle.
UV-Vis 300-1000 nmSaturation / clipping proche absorbance max ou réflectance maxSignal écrêtéTrès important si absorption forte.
UV-Vis 300-1000 nmRed-edge, position de maximum, ratios de bandes si végétalDécalage biologique ou artefact optiqueAide à distinguer changement réel et problème d'acquisition.
UV-Vis 300-1000 nmSmoothness / roughness indexBruit haute fréquenceSouvent plus informatif que le SNR seul.
MIR / ATR-FTIRATR contact quality index: intensité globale, aire totale, profondeur des bandes clésMauvais contact cristal-échantillonCrucial: beaucoup d'anomalies viennent du contact ATR.
MIR / ATR-FTIRCO2 / H2O atmospheric bandsMauvaise correction atmosphériquePics parasites fréquents.
MIR / ATR-FTIRBaseline curvature / rubber-band residualDiffusion, contact, dérive baselineTrès utile avant PCA.
MIR / ATR-FTIRPeak position shiftMauvais alignement spectral / calibrationImportant en FTIR car de petits shifts comptent.
MIR / ATR-FTIRBand area ratios sur bandes connuesSpectre chimiquement incohérentÀ adapter par matrice: polysaccharides, protéines, lipides, etc.
HS-MSTotal Ion Current (TIC), Base Peak Intensity (BPI)Injection faible, ionisation instableÉquivalent MS du niveau global spectral.
HS-MSNombre de pics détectésSpectre pauvre ou trop bruitéTrop peu = mauvais signal; trop = bruit/contamination.
HS-MSMass accuracy / m/z driftProblème calibration masseFondamental en HRMS.
HS-MSRetention time drift si LC/GC-MSDérive chromatographiqueÀ suivre sur standards/QC pools.
HS-MSBlank contamination scoreContaminants / carry-overComparer échantillons vs blancs.
HS-MSInternal standard CVVariabilité instrumentaleTrès robuste si standards disponibles.
HS-MSMissingness par featureInstabilité de détectionCrucial pour filtrer les variables.
Avec répétitionsRMS intra-échantillonRépétabilité globaleApplicable à toutes les technologies.
Avec répétitionsSAM / corrélation intra-échantillonRépétabilité de formeTrès utile pour spectres.
Avec répétitionsCV intra-échantillon par bande / featureRépétabilité localeDétecte les zones instables.
Avec répétitionsICC ou variance componentsPart variance échantillon vs techniqueTrès utile si plusieurs répétitions par sample.
Avec répétitionsDistance au centroïde intra-IDRépétition aberrantePermet de flagger la mauvaise répétition plutôt que le sample entier.
Bug-hunting / supervised audits
Famille de bug potentielMéthodes à ajouterCe que ça détecteÉtat dans l’explorateur
Shift spectral globalCorrélation spectre moyen inter-dataset, DTW, cross-correlation, comparaison positions de picsDécalage en longueur d'onde, mauvais alignement, interpolation différentePartiellement calculé: cross-correlation lag et dispersion des positions de pics vs spectre moyen.
Baseline / offset / gainRégression chaque spectre vs spectre moyen: x = a + b ref + residual; suivi de a, b, RMS résiduelOffset additif, effet multiplicatif, dérive de baselineCalculé dans reference.affine_*.
Mélange de lignes / mauvais appariement X-M-YVérification index, hash des lignes, duplication ID, distance spectrale intra-ID, labels incohérentsLignes mélangées, metadata mal alignées, Y attribué au mauvais spectrePartiellement couvert par répétabilité intra-ID; checks index/hash à ajouter au pipeline canonical.
Fuite d'information / répétitions mal splitéesGroupKFold par sample_id vs StratifiedKFold random; audit des partitions par sample_idPerformance artificiellement bonne due aux répétitionsNécessite splits et benchmark modèle; non calculé par la carte descriptive.
Label bugsÉchantillons proches en X mais Y différents, confident learning, erreurs systématiques FP/FNY inversés, erreurs de saisie, classes ambiguësNécessite Y et/ou modèle; recommandé pour l'explorateur supervisé.
Sous-domaines cachésPCA/UMAP/t-SNE + clustering non supervisé + association avec dataset/Y/date/operatorLots, campagnes, sondes, backgrounds non renseignésPartiellement calculé par structure PCA/LOF; UMAP/t-SNE hors carte statique.
Artefacts localisés inconnusCarte wavelength x dataset: différence moyenne, différence variance, KS par longueur d'ondeRégions spectrales anormales non anticipéesÀ calculer au niveau banque quand plusieurs datasets partagent un axe spectral.
Ruptures instrumentalesDiscontinuités dans dérivées, changepoint detectionSplice, raccord détecteur, saut local non prévuCalculé par jump/spike rates; changepoint plus avancé à ajouter.
Mélange / contamination spectraleNMF / unmixing / reconstruction par convex hullComposante externe: fond, plastique, solNon calculé automatiquement; nécessite hypothèses de composants ou grande bibliothèque.
Features instables mais prédictivesImportance modèle vs instabilité QC par variableModèle qui apprend un artefact plutôt qu'un signal biologiqueNécessite modèle supervisé; recommandé pour rapports de benchmark.

Variables

Targets 4

mineral_name

target · categorical
n / missing48 / 0
Classes48
Balance (entropy)1
Imbalance ratio1
Top classCorundum (1)

chemical_formula_sum

target · categorical
n / missing48 / 0
Classes48
Balance (entropy)1
Imbalance ratio1
Top classAl2 O3 (1)

compound_source

target · categorical
compound_source classescommercial powder Alfa Aesar …commercial powder Alfa Aesar 99.9%: 66commercial powder Alfa Aesar …commercial powder Alfa Aesar 99%: 44commercial Alfa Aesar 99%commercial Alfa Aesar 99%: 44commercial Prolabo purcommercial Prolabo pur: 22commercial Aldrich purcommercial Aldrich pur: 22commercial Chempur 99.9%commercial Chempur 99.9%: 22commercial Aldrich 99%commercial Aldrich 99%: 22commercial Alfa Aesar 99.99%commercial Alfa Aesar 99.99%: 22commercial Alfa Aesar 99.9%commercial Alfa Aesar 99.9%: 22Commercial powder Chem PUR 99…Commercial powder Chem PUR 99.97%: 11+10 more+10 more: 1010
n / missing48 / 0
Classes31
Balance (entropy)0.94
Imbalance ratio6
Top classcommercial powder Alfa Aesar 99.9% (6)

rod_database_code

target · categorical
n / missing48 / 0
Classes48
Balance (entropy)1
Imbalance ratio1
Top class3500102 (1)

Metadata 6

chemical_name_mineral

metadata · categorical
n / missing48 / 0
Classes48
Balance (entropy)1
Imbalance ratio1
Top classCorundum (1)

chemical_name_systematic

metadata · categorical
n / missing48 / 0
Classes48
Balance (entropy)1
Imbalance ratio1
Top classaluminium(III) oxide (1)

chemical_formula_structural

metadata · categorical
n / missing48 / 0
Classes48
Balance (entropy)1
Imbalance ratio1
Top classAl2 O3 (1)

chemical_compound_source

metadata · categorical
chemical_compound_source classescommercial powder Alfa Aesar …commercial powder Alfa Aesar 99.9%: 66commercial powder Alfa Aesar …commercial powder Alfa Aesar 99%: 44commercial Alfa Aesar 99%commercial Alfa Aesar 99%: 44commercial Prolabo purcommercial Prolabo pur: 22commercial Aldrich purcommercial Aldrich pur: 22commercial Chempur 99.9%commercial Chempur 99.9%: 22commercial Aldrich 99%commercial Aldrich 99%: 22commercial Alfa Aesar 99.99%commercial Alfa Aesar 99.99%: 22commercial Alfa Aesar 99.9%commercial Alfa Aesar 99.9%: 22Commercial powder Chem PUR 99…Commercial powder Chem PUR 99.97%: 11+10 more+10 more: 1010
n / missing48 / 0
Classes31
Balance (entropy)0.94
Imbalance ratio6
Top classcommercial powder Alfa Aesar 99.9% (6)

publ_section_title

metadata · categorical
publ_section_title classesRaman spectrum of commercial …Raman spectrum of commercial boron trioxide: 22Raman spectrum of commercial …Raman spectrum of commercial aluminium(III) oxide: 11Raman spectrum of commercial …Raman spectrum of commercial molybdenum(VI) oxide: 11Raman spectrum of commercial …Raman spectrum of commercial silver(I) chloride: 11Raman spectrum of commercial …Raman spectrum of commercial Ba(NO3)2: 11Raman spectrum of commercial …Raman spectrum of commercial BaO2: 11Raman spectrum of commercial …Raman spectrum of commercial BaSO4: 11Raman spectrum of commercial …Raman spectrum of commercial BaTiO3: 11Raman spectrum of commercial …Raman spectrum of commercial Bi2O3: 11Raman spectrum of commercial …Raman spectrum of commercial (BiO)2CO3: 11+10 more+10 more: 1010
n / missing48 / 0
Classes47
Balance (entropy)1
Imbalance ratio2
Top classRaman spectrum of commercial boron trioxide (2)

journal_year

metadata · numeric
journal_year distribution02040602,017 – 2017: 442017 – 2017: 02017 – 2017: 02017 – 2017: 02017 – 2017: 02017 – 2018: 02018 – 2018: 02018 – 2018: 02018 – 2018: 02018 – 2018: 02018 – 2018: 02018 – 2,018: 02,018 – 2018: 32018 – 2018: 02018 – 2018: 02018 – 2018: 02018 – 2018: 02018 – 2018: 02018 – 2019: 02019 – 2019: 02019 – 2019: 02019 – 2019: 02019 – 2019: 02019 – 2,019: 12,017.02,017.52,018.02,018.52,019.0
n / missing48 / 0
Mean ± SD2017 ± 0.371
Median2,017
Range2,017 – 2,019
CV0.000184
Skew / kurtosis3.9 / 16
Normal?no
Constant metadata 8
  • axis_digest8dc604ea4b2c277f
  • axis_unitcm^-1
  • axis_min50.51
  • axis_max2000
  • n_points_original2,023
  • spectroscopy_typeRaman
  • axis_statusreal_common_axis_subset
  • interpolation_appliedfalse

7 variable(s) omitted (no recorded values).

Alignment

Alignment levelobservation
Sample id availableyes
Samples48
Observations (total)48
Reps per samplemin 1 · mean 1 · max 1

Provenance & citation

ContributorRaman Open Database
Origin · url [open]https://solsa.crystallography.net/rod/
Origin · script [manual]source_to_standard.py — standardization script (maintainer-only)

Governance & integrity

Tierpublic
LicenseCC0-1.0
Permitted useResearch and benchmarking.
Access policyOpen per source license.
RedistributionROD states that all data and the database are CC0/public domain. Users should acknowledge the original authors of the structural data.
Content version1.0.0
Schema / protocol2.0
Content hash3351b0c917d4ced1…
Processing hash8f6e5955419978fa…
Metadata hash6b80895a9847ac60…

Load this dataset

# pip install nirs4all-datasets
from nirs4all_datasets import get

ds = get("rod_raman_native_axis_2023points")            # DOI-pinned, checksum-verified, cached
X, y = ds.x(), ds.y()
print(X.shape, y.shape)
card.jsoncroissant.jsonIdentity metadata only — the dataset bytes live at the origin / DOI.