← Back to the catalog
Open source accessOpen redistributionraw reproducible

EcoSIS seasonal canopy spectra and traits, Blackhawk Island, WI

ecosis · NIR

EcoSIS seasonal canopy spectra and traits, Blackhawk Island, WI. Origin database composed from 3 standardized v2.0 leaves: 1 spectral source(s), 3 declared target(s). Auto-generated from dataset_card.json (verify before publication).

nirv2ecosis
80
samples
187
wavelengths
1
sources
3
targets
30
metadata
NIR
family

Provenance & citation

Where the original data and publications come from. Follow these links to obtain the source and cite its authors. Reading guide

ContributorSeasonal canopy spectra and traits, Blackhawk Island, WI
Conversion statusok
Origin · url [open]https://data.ecosis.org/dataset/seasonal-canopy-spectra-and-traits--blackhawk-island--wi
Origin · url [open]https://data.ecosis.org/api/3/action/package_show?id=seasonal-canopy-spectra-and-traits--blackhawk-island--wi
Origin · url [open]https://ecosis.org/package/seasonal-canopy-spectra-and-traits--blackhawk-island--wi

Governance & integrity

Source license, redistribution conditions, content version and identity hashes. Redistribution tier and original-source availability are separate. Reading guide

Tierpublic
LicensePDDL-1.0
Permitted useResearch and benchmarking.
Access policyOpen per source license.
RedistributionEcoSIS CKAN API package_show verified open license: Open Data Commons Public Domain Dedication and License (PDDL).
Content version1.1.0
Schema / protocol2.0
Content hash6c9d539ae0268e0f…
Processing hash009752c2f643d8ef…
Metadata hash3092d4247ce32cde…

Dataset property explorer

Start with the profile axes to locate unusual variation, then inspect the measured values and evidence below. Scores are descriptive heuristics. Reading guide

Mean available profile score0.55
Highest axisLocal artifacts · 1.00
Diagnostics8
Sources profiled1

How to read the profile

The center is 0 and the outer ring is 1. Larger values indicate stronger anomaly or heterogeneity signals on that axis. Compare individual axes using the table; this is not an overall quality grade. Missing axes are left blank, and partial profiles have no filled polygon.

EcoSIS seasonal canopy spectra and traits, Blackhawk Island, WI property profile0.250.50.751integritynoiseartefactsbaselinePCA outliersreferencerepeatabilitystructureEcoSIS seasonal canopy spectra and traits, Blackhawk Island, WI — integrity: 0.00EcoSIS seasonal canopy spectra and traits, Blackhawk Island, WI — noise: 0.03EcoSIS seasonal canopy spectra and traits, Blackhawk Island, WI — artefacts: 1.00EcoSIS seasonal canopy spectra and traits, Blackhawk Island, WI — baseline: 0.42EcoSIS seasonal canopy spectra and traits, Blackhawk Island, WI — PCA outliers: 0.97EcoSIS seasonal canopy spectra and traits, Blackhawk Island, WI — reference: 0.74EcoSIS seasonal canopy spectra and traits, Blackhawk Island, WI — structure: 0.67EcoSIS seasonal…0 center · 1 outer ring · outward = stronger anomaly / heterogeneity signal

Profile axes

Dimensionless scores from 0 to 1 summarize each property; larger values indicate stronger signals. Unavailable axes are not zero.

Integrity
?Combines missing cells, zero columns and infinite values. Higher values call for checking data completeness.
0.00
Noise
?Combines roughness and its signal-to-roughness proxy. Real narrow bands may also contribute.
0.03
Local artifacts
?Combines spike, jump and clipping heuristics. Inspect flagged spectral regions before attributing a cause.
1.00
Baseline/shape
?Summarizes baseline slope and excess edge variation relative to signal scale.
0.42
PCA outliers
?Combines relative PCA residual and score-distance tails. Valid rare spectra can produce a high value.
0.97
Distance to average spectrum
?Dispersion around this dataset's mean spectrum, using distance, shape and shift summaries.
0.74
Repeatability
?Dispersion among observations sharing an ID. Interpretation depends on the documented meaning of that ID.
unavailable
Multi-regime structure
?Variation in local density in PCA space. May reflect legitimate batches or subpopulations.
0.67

Possible explanations to investigate

Bars rank heuristic signatures from 0 to 1. They do not estimate the probability of a physical fault. On narrow screens, scroll the chart horizontally. Full labels, scores, evidence coverage, possible causes and required external checks are in the table below.

Diagnostic hypotheses00.250.50.751hypothesis scoreSignature compatible with a spectral spliceSignature compatible with a spectral splice: 0.880.88Offset compatible with a different white referenceOffset compatible with a different white reference: 0.570.57Signature compatible with a different backgroundSignature compatible with a different background: 0.510.51Signature compatible with a population shiftSignature compatible with a population shift: 0.440.44High spectral roughness signatureHigh spectral roughness signature: 0.410.41Signature compatible with clippingSignature compatible with clipping: 0.400.40Flat spectrum/weak signalFlat spectrum/weak signal: 0.190.19

Heuristic signature scores are not calibrated probabilities of physical causes: 0.78 does not mean a 78% causal probability. Missing evidence remains unavailable. RMS/SAM describe dispersion around the dataset mean, without an independent external reference.

Diagnostic hypotheses and supporting evidence
DiagnosticScoreHeuristic strengthEvidence coverageSignalsPossible causeRequired external checks
Signature compatible with a spectral spliceX0.88strong100 %Spike rate 1.00, Jump rate 1.00, PCA Q 0.97Break at detector junctions, local calibration or different probe.Check the white/black reference actually acquired and its metadata.
Check instrument, probe, geometry, campaign and processing/resampling log.
Check the repeat protocol before interpreting an intra-ID dispersion.
Offset compatible with a different white referenceX0.57medium100 %local artifacts 1.00, PCA Q 0.97, RMS/SAM to mean spectrum 0.74Systematic discrepancy between campaigns, instruments or white reference.Check the white/black reference actually acquired and its metadata.
Check instrument, probe, geometry, campaign and processing/resampling log.
Check the repeat protocol before interpreting an intra-ID dispersion.
Signature compatible with a different backgroundX0.51medium100 %PCA Q 0.97, RMS/SAM to mean spectrum 0.74, Mahalanobis / T2 0.49Systematic effect of support, white/black, transflectance or measurement environment.Check the white/black reference actually acquired and its metadata.
Check instrument, probe, geometry, campaign and processing/resampling log.
Check the repeat protocol before interpreting an intra-ID dispersion.
Signature compatible with a population shiftX0.44medium100 %RMS/SAM to mean spectrum 0.74, PCA structure 0.67, Mahalanobis / T2 0.49Different but physically plausible variety, species, batch or condition.Check the white/black reference actually acquired and its metadata.
Check instrument, probe, geometry, campaign and processing/resampling log.
Check the repeat protocol before interpreting an intra-ID dispersion.
High spectral roughness signatureX0.41weak100 %Spike rate 1.00, PCA Q 0.97, RMS/SAM to mean spectrum 0.74Weak signal, detector problem, lamp or unstable acquisition.Check the white/black reference actually acquired and its metadata.
Check instrument, probe, geometry, campaign and processing/resampling log.
Check the repeat protocol before interpreting an intra-ID dispersion.
Signature compatible with clippingX0.40weak100 %Jump rate 1.00, PCA Q 0.97, Baseline/mean/area 0.42Detector saturated or insufficient dynamic range.Check the white/black reference actually acquired and its metadata.
Check instrument, probe, geometry, campaign and processing/resampling log.
Check the repeat protocol before interpreting an intra-ID dispersion.
Flat spectrum/weak signalX0.19weak100 %PCA Q 0.97Bad contact, missing sample, degraded measurement or very low dynamic range.Check the white/black reference actually acquired and its metadata.
Check instrument, probe, geometry, campaign and processing/resampling log.
Check the repeat protocol before interpreting an intra-ID dispersion.
Weak signatures observedX—unknown90 %Weak signatures on available metrics; does not certify either physical validity or the absence of defects.Check the white/black reference actually acquired and its metadata.
Check instrument, probe, geometry, campaign and processing/resampling log.
Check the repeat protocol before interpreting an intra-ID dispersion.

Spectral sources

Each block is a separate instrument or spectral source. Read its signal summary before using PCA to explore variation between observations. Reading guide

bhi2018_plot_spectra

X · NIR

Read the signal and variation summaries for this source. Axis unit: nm; signal representation: not recorded.

Spectral signal summary

The mean and median describe the typical signal at each channel; shaded bands show the 25th–75th and 5th–95th percentiles across observations. A wider band means greater variation, which can be biological or instrumental.

bhi2018_plot_spectra spectra020406005001,0001,5002,0002,500q05-q95 envelopeq25-q75 envelopemedian spectrummedianq25–q75q05–q95wavelength / nm407.1nm — median 1.051 (q25–q75 0.7955–1.253)413.5nm — median 1.169 (q25–q75 0.9181–1.395)426.3nm — median 1.465 (q25–q75 1.183–1.708)432.7nm — median 1.532 (q25–q75 1.263–1.799)439.1nm — median 1.548 (q25–q75 1.26–1.813)451.8nm — median 1.547 (q25–q75 1.29–1.839)458.2nm — median 1.567 (q25–q75 1.311–1.839)464.6nm — median 1.588 (q25–q75 1.318–1.852)477.4nm — median 1.614 (q25–q75 1.339–1.896)483.8nm — median 1.653 (q25–q75 1.374–1.929)490.2nm — median 1.671 (q25–q75 1.395–1.949)502.9nm — median 1.859 (q25–q75 1.564–2.146)509.3nm — median 2.081 (q25–q75 1.737–2.47)515.7nm — median 2.445 (q25–q75 2.058–2.916)528.5nm — median 3.653 (q25–q75 3.102–4.428)534.9nm — median 4.15 (q25–q75 3.543–5.055)541.2nm — median 4.456 (q25–q75 3.747–5.456)554nm — median 4.815 (q25–q75 4.054–5.973)560.4nm — median 4.676 (q25–q75 3.954–5.937)566.8nm — median 4.361 (q25–q75 3.664–5.683)579.6nm — median 3.639 (q25–q75 3.098–4.781)586nm — median 3.457 (q25–q75 2.937–4.536)592.3nm — median 3.345 (q25–q75 2.817–4.481)605.1nm — median 3.207 (q25–q75 2.719–4.317)611.5nm — median 3.057 (q25–q75 2.585–4.145)617.9nm — median 2.903 (q25–q75 2.41–3.939)630.7nm — median 2.797 (q25–q75 2.311–3.817)637nm — median 2.756 (q25–q75 2.299–3.759)643.4nm — median 2.577 (q25–q75 2.213–3.515)656.2nm — median 2.336 (q25–q75 1.981–3.027)662.6nm — median 2.196 (q25–q75 1.817–2.733)669nm — median 2.107 (q25–q75 1.724–2.52)681.8nm — median 2.197 (q25–q75 1.807–2.589)688.1nm — median 2.521 (q25–q75 2.124–3.2)694.5nm — median 3.586 (q25–q75 3.019–4.958)707.3nm — median 8.916 (q25–q75 7.848–12.2)713.7nm — median 12.91 (q25–q75 11.21–16.88)726.5nm — median 21.8 (q25–q75 19.13–24.74)732.8nm — median 26.76 (q25–q75 22.37–30.3)739.2nm — median 30.89 (q25–q75 24.8–35.07)752nm — median 36.66 (q25–q75 28.89–41.75)758.4nm — median 38.74 (q25–q75 29.94–43.69)764.8nm — median 39.95 (q25–q75 30.65–44.92)777.6nm — median 41.09 (q25–q75 31.38–45.91)783.9nm — median 41.48 (q25–q75 31.68–46.19)790.3nm — median 41.76 (q25–q75 31.92–46.41)803.1nm — median 42.31 (q25–q75 32.4–47.03)809.5nm — median 42.54 (q25–q75 32.66–47.21)815.9nm — median 42.71 (q25–q75 32.78–47.51)828.6nm — median 43.1 (q25–q75 33.28–47.66)835nm — median 43.34 (q25–q75 33.59–47.77)841.4nm — median 43.6 (q25–q75 33.97–47.93)854.2nm — median 44.32 (q25–q75 34.69–48.72)860.6nm — median 44.51 (q25–q75 34.95–48.88)867nm — median 44.71 (q25–q75 35.14–49.04)879.7nm — median 45.06 (q25–q75 35.56–49.24)886.1nm — median 45.17 (q25–q75 35.77–49.43)892.5nm — median 45.25 (q25–q75 35.84–49.49)905.3nm — median 45.23 (q25–q75 35.9–49.32)911.7nm — median 44.89 (q25–q75 35.84–49.04)918.1nm — median 44.93 (q25–q75 35.84–48.99)930.8nm — median 44.89 (q25–q75 35.91–49.92)937.2nm — median 44.37 (q25–q75 35.64–49.27)943.6nm — median 43.88 (q25–q75 35.66–48.66)956.4nm — median 42.61 (q25–q75 35.3–46.9)962.8nm — median 41.49 (q25–q75 34.74–45.58)969.2nm — median 41.21 (q25–q75 34.49–44.61)983.4nm — median 41.16 (q25–q75 34.39–44.48)994.4nm — median 41.75 (q25–q75 34.91–45.05)1005.2nm — median 42.29 (q25–q75 35.34–45.6)1,027nm — median 43.89 (q25–q75 36.74–47.32)1037.9nm — median 44.65 (q25–q75 37.44–48.28)1048.8nm — median 45.29 (q25–q75 37.99–48.91)1070.6nm — median 45.88 (q25–q75 38.93–49.74)1081.5nm — median 46.34 (q25–q75 39.36–50.23)1092.4nm — median 45.09 (q25–q75 38.44–48.79)1114.2nm — median 43.26 (q25–q75 36.72–47.25)1125.1nm — median 42.61 (q25–q75 35.76–46.19)1,136nm — median 40.7 (q25–q75 34.28–43.54)1157.8nm — median 34.99 (q25–q75 31.05–37.6)1168.7nm — median 34.93 (q25–q75 31.23–37.59)1179.6nm — median 35.19 (q25–q75 31.56–37.84)1201.4nm — median 35.97 (q25–q75 32.16–38.8)1212.3nm — median 36.83 (q25–q75 32.91–39.62)1223.2nm — median 37.01 (q25–q75 33.07–39.82)1,245nm — median 39.31 (q25–q75 34.53–42.15)1255.9nm — median 40 (q25–q75 34.96–42.87)1266.8nm — median 40.4 (q25–q75 35.28–43.34)1288.6nm — median 40.44 (q25–q75 35.32–43.36)1299.5nm — median 39.91 (q25–q75 35.22–43.03)1310.4nm — median 39.22 (q25–q75 34.62–42.36)1506.6nm — median 10.34 (q25–q75 9.456–11.86)1517.5nm — median 11.19 (q25–q75 10.22–12.83)1528.4nm — median 12.05 (q25–q75 11.06–13.8)1550.2nm — median 13.73 (q25–q75 12.57–15.44)1561.1nm — median 14.58 (q25–q75 13.35–16.3)1,572nm — median 15.4 (q25–q75 14.06–17.2)1593.8nm — median 17.01 (q25–q75 15.66–18.86)1604.6nm — median 17.79 (q25–q75 16.41–19.63)1615.6nm — median 18.45 (q25–q75 17.11–20.36)1637.4nm — median 19.32 (q25–q75 18.15–21.47)1648.2nm — median 19.52 (q25–q75 18.52–21.75)1659.2nm — median 19.57 (q25–q75 18.64–21.86)1,681nm — median 19.78 (q25–q75 18.52–22.05)1691.8nm — median 19.44 (q25–q75 18.06–21.73)1713.6nm — median 18.52 (q25–q75 16.96–20.9)1724.6nm — median 18.04 (q25–q75 16.53–20.45)1735.4nm — median 17.77 (q25–q75 16.25–19.98)1757.2nm — median 17.03 (q25–q75 15.68–18.99)1768.2nm — median 16.63 (q25–q75 15.41–18.53)1,779nm — median 16.9 (q25–q75 15.8–18.83)1986.2nm — median 3.193 (q25–q75 2.892–3.916)1,997nm — median 3.667 (q25–q75 3.303–4.444)2,008nm — median 4.031 (q25–q75 3.685–4.822)2029.8nm — median 4.517 (q25–q75 4.014–5.454)2040.6nm — median 4.735 (q25–q75 4.197–5.687)2051.6nm — median 5.061 (q25–q75 4.478–6.074)2073.4nm — median 5.52 (q25–q75 4.893–6.684)2084.2nm — median 5.72 (q25–q75 5.074–6.87)2095.2nm — median 5.961 (q25–q75 5.262–7.13)2,117nm — median 6.396 (q25–q75 5.618–7.557)2127.8nm — median 6.571 (q25–q75 5.76–7.73)2138.7nm — median 6.761 (q25–q75 5.919–7.959)2160.5nm — median 7.142 (q25–q75 6.362–8.494)2171.4nm — median 7.389 (q25–q75 6.617–8.729)2182.3nm — median 7.683 (q25–q75 6.954–9.124)2204.1nm — median 8.435 (q25–q75 7.677–9.921)2,215nm — median 8.523 (q25–q75 7.773–9.988)2225.9nm — median 8.429 (q25–q75 7.678–9.87)2247.7nm — median 7.899 (q25–q75 7.092–9.296)2258.6nm — median 7.411 (q25–q75 6.726–8.751)2269.5nm — median 7.003 (q25–q75 6.288–8.223)2291.3nm — median 6.406 (q25–q75 5.81–7.61)2302.2nm — median 6.024 (q25–q75 5.448–7.168)2313.1nm — median 5.655 (q25–q75 5.11–6.84)2334.9nm — median 5.39 (q25–q75 4.971–6.494)2345.8nm — median 5.245 (q25–q75 4.891–6.364)2356.7nm — median 5.06 (q25–q75 4.709–6.158)2378.5nm — median 5.212 (q25–q75 4.745–6.242)2389.4nm — median 5.073 (q25–q75 4.567–6.041)

Sampling

How many observations and spectral channels were exported, and how the wavelength axis is spaced. Reading guide

Wavelengths
?Number of spectral channels. A channel can represent wavelength, wavenumber or another feature axis.
187
Axis range
?Lowest and highest recorded spectral-axis coordinates, in the stated unit.
407.1–2389 nm
Mean spacing
?Average difference between adjacent spectral-axis coordinates; compare only within the same unit.
10.7 nm
Grid
?Uniform means adjacent axis spacings are approximately equal. An irregular grid may need care when applying derivatives.
irregular
Observations
?Exported spectral rows in this source, including repeated measurements when present.
80

Signal & quality

Signal level and roughness summaries. These depend on the signal representation and are not instrument acceptance tests. Reading guide

Value range
?Minimum and maximum recorded spectral values, in the original signal representation.
0.386 – 60.2
Mean range
?Minimum and maximum of the mean spectrum across spectral channels.
1.04 – 44.7
Mean level
?Average signal over observations and channels. The historical key mean_reflectance may also store other signal representations.
20
Area
?Trapezoidal integral of the mean spectrum over the sorted recorded axis; its unit is signal multiplied by axis unit.
3.882e+04
PTP
?Peak-to-peak: maximum minus minimum of the mean spectrum. Low values indicate little variation along the mean spectrum.
43.66
Noise RMS
?Historical roughness sigma proxy from robust second differences. Narrow genuine bands can also raise it; this is not repeat-measured instrument noise.
0.069947
Roughness S/N proxy
?Average absolute signal divided by the roughness proxy. Higher means smoother signal relative to its amplitude, not certified instrument SNR.
2.9e+02
Roughness S/N proxy dB
?20 log10 of the roughness signal-to-noise proxy. Units are decibels; compare only compatible signal representations.
5e+01 dB
Dynamic range
?Maximum minus minimum of the mean spectrum. Its magnitude depends on the signal representation.
43.7
Smoothness
?Mean per-spectrum RMS of second differences, in signal units. Smaller values indicate smoother spectra under this protocol.
3.18
Saturated
?Fraction at the observed global maximum; a heuristic indicator, not a comparison with known detector limits.
0.0%
X-outliers
?Number flagged by the qualification outlier method. An unusual spectrum can be valid and should not be discarded automatically.
29

Integrity & artefacts

Missing values, narrow spikes and abrupt jumps to investigate in the original spectra. Reading guide

NaN ratio
?Missing spectral cells divided by all spectral cells, displayed as a percentage.
0.00%
Inf count
?Number of positive or negative infinite spectral values; investigate invalid calculations or export.
0
Zero ratio
?Exactly zero spectral cells divided by all cells. Zero can be a valid measurement and is not automatically missing.
0.00%
Spike count
?Local narrow peaks flagged by the second-difference heuristic; real sharp spectral bands may also be flagged.
620
Spike rate
?Fraction of tested second-difference positions flagged as spikes, displayed as a percentage.
4.19%
Jump count
?Adjacent-channel changes flagged by the first-difference heuristic, potentially including detector joins.
588
Jump rate
?Fraction of tested adjacent-channel differences flagged as jumps, displayed as a percentage.
3.95%
Clip fraction
?Fraction of finite cells near the observed global minimum or maximum; inspect detector limits before concluding saturation.
0.01%

Shape & reference

Variation relative to this dataset's mean spectrum; the mean is not an independently measured calibration reference. Reading guide

Baseline slope
?Linear slope fitted to the mean spectrum over an axis normalized to 0–1. It describes total baseline change, not change per physical axis unit.
-9.1263
Curvature RMS
?Median per-spectrum RMS of second differences, summarizing curvature and high-frequency variation.
3.2219
D1 RMS
?Median per-spectrum RMS of adjacent-channel first differences; reflects both real spectral structure and artefacts.
2.4997
RMS to mean
?Root mean square distance to this dataset's mean spectrum, in signal units.
3.7983
RMS p95
?95th percentile of distances to the mean spectrum: 95% of observations have a distance at or below this value.
8.059
SAM to mean
?Spectral Angle Mapper: angle to the mean spectrum, in radians. Smaller angles indicate more similar shapes.
0.058524
SAM p95
?95th percentile of spectral angles to the dataset mean, in radians. It is less sensitive to overall amplitude than RMS.
0.18459
Affine offset p95
?95th percentile of absolute fitted offsets when matching each spectrum to the dataset mean.
4.4922
Affine gain p95 Δ
?95th percentile of the absolute gain deviation from 1 in the fit to the mean spectrum.
0.36908
Affine residual p95
?95th percentile of residual RMS after gain and offset correction to the mean spectrum.
2.7983
Xcorr lag p95
?95th percentile of the absolute cross-correlation shift relative to the mean spectrum, in spectral channels.
0

Outliers & repeatability

Unusual spectra and within-ID dispersion. Repeated IDs do not by themselves establish technical repetitions. Reading guide

PCA Q p95/median
?Q (squared prediction error) is variation left outside the retained PCA subspace. The displayed ratio compares its 95th percentile with its median.
7.7
Hotelling T2 p95/median
?Hotelling T² measures distance within the retained PCA subspace, scaled by component variance. Ratio of the 95th percentile to the median.
3.9
Mahalanobis H p95/median
?Distance from the PCA-score center after variance scaling. Ratio of the 95th percentile to the median; large values identify relatively extreme spectra.
2
Repeat groups
?Number of IDs with several observations. Source documentation is needed to decide whether these are technical repeats, positions or time points.
0

Dimensionality (PCA)

Principal component analysis (PCA) compresses correlated wavelengths into components. This describes spectral variation, without using prediction targets. Reading guide

Effective rank
?Entropy-based summary of the variance distribution across components. Larger values indicate variation spread across more dimensions.
1.7
PCs → 95% var
?Number of principal components needed to explain 95% of spectral variance, when reached by the computed projection.
2
PCs → 99% var
?Number of principal components needed to explain 99% of spectral variance, when reached by the computed projection.
4
Top-10 cum. var
?Fraction of spectral variance explained by up to the first ten computed principal components, displayed as a percentage.
99.9%
Computed metric scores 30highest alert 1.00

Value is the measured quantity; alert score is its heuristic mapping to 0–1. Levels are weak below 0.42, medium from 0.42, and strong from 0.72. These are display bands, not calibrated acceptance thresholds. A dash means unavailable, never zero. Possible causes are suggestions to investigate. Use each metric’s ? control for its meaning and scoring: hover for a hint, or expand it with a tap, Enter or Space.

FamilyComputed metricValueAlert scoreHeuristic levelDescriptive interpretationPossible causes to verifyCalculation / scoring
Data integrityInvalid/masked cell count (owner report)
?Count of cells reported unavailable by the native owner under its null or validity mask. This count is distinct from the historical NaN ratio; consult the recorded population and denominator. Scoring: No alert mapping is defined for this metric; an unavailable score does not mean a zero measured value. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
integrity.missing_cells
——not calculableNot enough information to score this metric on this dataset.Missing data or validity mask; not evidence of an acquisition causeNative Preflight count of cells unavailable under x/null and valid_mask; denominator stays in native_metric.denominators.n_cells. Not legacy NaN ratio.
Data integrityNaN ratio
?Missing spectral cells divided by all spectral cells, displayed as a percentage. Scoring: alert = min(1, nan_ratio / 0.05). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
integrity.nan_ratio
0%0.00weakFull spectrumAcquisition/export errorcount(isnan(X)) / X.sizealert = min(1, nan_ratio / 0.05)
Data integrityInf count
?Number of positive or negative infinite spectral values; investigate invalid calculations or export. Scoring: alert = min(1, inf_count / 1). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
integrity.inf_count
00.00weakNormalInvalid calculationscount(isinf(X))alert = min(1, inf_count / 1)
Data integrityZero ratio
?Exactly zero spectral cells divided by all cells. Zero can be a valid measurement and is not automatically missing. Scoring: alert = min(1, zero_ratio / 0.05). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
integrity.zero_ratio
0%0.00weakNormalExport, saturationcount(X == 0) / count(finite X)alert = min(1, zero_ratio / 0.05)
Overall amplitudeMean reflectance
?Average signal over observations and channels. The historical key mean_reflectance may also store other signal representations. Scoring: alert reuses baseline/shape drift because absolute reflectance ranges are technology-dependent. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
amplitude.mean_reflectance
20.0040.42weakToo darkBackground, geometrymean(X finite)alert reuses baseline/shape drift because absolute reflectance ranges are technology-dependent
Overall amplitudeArea under curve
?Trapezoidal integral of the mean spectrum over the sorted recorded axis; its unit is signal multiplied by axis unit. Scoring: alert reuses baseline/shape drift because area scale depends on axis and units. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
amplitude.area_under_curve
388170.42weakNormalProbe distancetrapezoid(mean_spectrum, spectral_axis)alert reuses baseline/shape drift because area scale depends on axis and units
Overall amplitudePeak-to-peak (PTP)
?Peak-to-peak: maximum minus minimum of the mean spectrum. Low values indicate little variation along the mean spectrum. Scoring: alert increases when dynamic range is abnormally flat. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
amplitude.peak_to_peak
43.6610.00weakStrong variabilitySaturationmax(mean_spectrum) - min(mean_spectrum)alert increases when dynamic range is abnormally flat
Overall amplitudeVariance
?Variance of all finite spectral cells, in squared signal units. It combines variation across observations and channels; a small value can describe a flat signal. Scoring: alert increases when variance/dynamic range is abnormally flat. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
amplitude.variance
290.660.00weakNormal or heterogeneousBad contactvar(X finite)alert increases when variance/dynamic range is abnormally flat
NoiseRoughness sigma proxy
?Historical roughness sigma proxy from robust second differences. Narrow genuine bands can also raise it; this is not repeat-measured instrument noise. Scoring: alert = noise_rms / signal_scale, saturated at 5%. Signal scale is the larger of the absolute mean level and absolute peak-to-peak range, with a floor of 1e-12. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
noise.roughness_sigma_proxy
0.0699470.03weakStableLamp, detectormedian MAD(second derivative) * 1.4826 / sqrt(6)alert = noise_rms / signal_scale, saturated at 5%
NoiseRoughness S/N proxy
?Average absolute signal divided by the roughness proxy. Higher means smoother signal relative to its amplitude, not certified instrument SNR. Scoring: alert decreases with SNR dB; >=40 dB is treated as low alert. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
noise.roughness_signal_to_noise_proxy
285.990.00weakGood signalAcquisitionmean(abs(X)) / noise_rmsalert decreases with SNR dB; >=40 dB is treated as low alert
NoiseBandwise roughness S/N proxy
?Minimum channel-wise ratio of absolute mean signal to local second-difference roughness. A smaller ratio identifies a weak or rough spectral region; genuine narrow bands and near-zero signal can also lower it. This is not certified instrument SNR. Scoring: alert decreases with worst-band SNR dB; >=35 dB is treated as low alert. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
noise.bandwise_roughness_signal_to_noise_proxy_min
4.06320.65mediumProblem areaDetectormin(abs(mean_spectrum) / local second-derivative noise)alert decreases with worst-band SNR dB; >=35 dB is treated as low alert
Local artifactsSpike count
?Local narrow peaks flagged by the second-difference heuristic; real sharp spectral bands may also be flagged. Scoring: alert follows spike_rate, saturated at 1%. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
artefacts.spike_count
6201.00strongArtifactsCosmic rays, splicecount robust outliers in second derivativealert follows spike_rate, saturated at 1%
Local artifactsSpike rate
?Fraction of tested second-difference positions flagged as spikes, displayed as a percentage. Scoring: alert = min(1, spike_rate / 0.01). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
artefacts.spike_rate
4.19%1.00strongSuspicious spectrumInterpolationspike_count / (n_samples * (n_features - 2))alert = min(1, spike_rate / 0.01)
Local artifactsJump count
?Adjacent-channel changes flagged by the first-difference heuristic, potentially including detector joins. Scoring: alert follows jump_rate, saturated at 1%. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
artefacts.jump_count
5881.00strongDetector connectionSplicecount robust outliers in first derivativealert follows jump_rate, saturated at 1%
Local artifactsJump rate
?Fraction of tested adjacent-channel differences flagged as jumps, displayed as a percentage. Scoring: alert = min(1, jump_rate / 0.01). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
artefacts.jump_rate
3.95%1.00strongSpectral problemCalibrationjump_count / (n_samples * (n_features - 1))alert = min(1, jump_rate / 0.01)
Local artifactsClip fraction
?Fraction of finite cells near the observed global minimum or maximum; inspect detector limits before concluding saturation. Scoring: alert = min(1, clip_fraction / 0.01). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
artefacts.clip_fraction
0.0134%0.01weakNormalDetector saturatedfraction of finite cells equal to repeated min/max extremaalert = min(1, clip_fraction / 0.01)
Spectral formBaseline slope
?Linear slope fitted to the mean spectrum over an axis normalized to 0–1. It describes total baseline change, not change per physical axis unit. Scoring: alert = abs(slope / signal_scale), saturated at 0.5. Signal scale is the larger of the absolute mean level and absolute peak-to-peak range, with a floor of 1e-12. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
shape.baseline_slope
-9.12630.42weakStableIlluminationlinear slope of mean_spectrum over normalized axisalert = abs(slope / signal_scale), saturated at 0.5
Spectral formCurvature RMS
?Median per-spectrum RMS of second differences, summarizing curvature and high-frequency variation. Scoring: alert = curvature_rms / signal_scale, saturated at 1%. Signal scale is the larger of the absolute mean level and absolute peak-to-peak range, with a floor of 1e-12. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
shape.curvature_rms
3.22191.00strongUnusual shapeBackground, splicemedian RMS(second derivative per spectrum)alert = curvature_rms / signal_scale, saturated at 1%
Spectral formD1 RMS
?Median per-spectrum RMS of adjacent-channel first differences; reflects both real spectral structure and artefacts. Scoring: alert = d1_rms / signal_scale, saturated at 5%. Signal scale is the larger of the absolute mean level and absolute peak-to-peak range, with a floor of 1e-12. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
shape.d1_rms
2.49971.00strongStructured spectrumBiology or artifactmedian RMS(first derivative per spectrum)alert = d1_rms / signal_scale, saturated at 5%
Multivariate outliersPCA Q (SPE)
?Q (squared prediction error) is variation left outside the retained PCA subspace. The displayed ratio compares its 95th percentile with its median. Scoring: alert = min(1, pca_q_ratio / 8). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
outliers.pca_q_ratio
7.72260.97strongAtypical spectrumArtifact, mixturep95(Q/SPE residual) / median(Q/SPE residual)alert = min(1, pca_q_ratio / 8)
Multivariate outliersHotelling T²
?Hotelling T² measures distance within the retained PCA subspace, scaled by component variance. Ratio of the 95th percentile to the median. Scoring: alert = min(1, hotelling_t2_ratio / 8). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
outliers.hotelling_t2_ratio
3.87870.48mediumExtreme but consistentNatural variabilityp95(Hotelling T2) / median(Hotelling T2)alert = min(1, hotelling_t2_ratio / 8)
Multivariate outliersMahalanobis H
?Distance from the PCA-score center after variance scaling. Ratio of the 95th percentile to the median; large values identify relatively extreme spectra. Scoring: alert = min(1, mahalanobis_h_ratio / 4). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
outliers.mahalanobis_h_ratio
1.96910.49mediumGlobal outlierDifferent domainp95(sqrt(T2)) / median(sqrt(T2))alert = min(1, mahalanobis_h_ratio / 4)
Comparison to average spectrumRMS to mean spectrum
?95th percentile of distances to the mean spectrum: 95% of observations have a distance at or below this value. Scoring: alert = RMS_p95 / signal_scale, saturated at 25%. Signal scale is the larger of the absolute mean level and absolute peak-to-peak range, with a floor of 1e-12. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
reference.rms_to_mean_spectrum_p95
8.0590.74strongDifferent spectrumDomain shiftp95 RMS distance to dataset mean spectrumalert = RMS_p95 / signal_scale, saturated at 25%
Comparison to average spectrumSpectral Angle Mapper (SAM)
?95th percentile of spectral angles to the dataset mean, in radians. It is less sensitive to overall amplitude than RMS. Scoring: alert = min(1, SAM_p95 / 0.35 rad). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
reference.sam_to_mean_spectrum_p95
0.184590.53mediumDifferent shapeBackground, geometryp95 spectral angle to dataset mean spectrumalert = min(1, SAM_p95 / 0.35 rad)
RepeatabilityRMS intra-ID
?Within-ID root mean square deviation from the group's mean spectrum, in signal units. Repeated IDs require documentation before this spread can be called technical repeatability. Scoring: alert = RMS_intra_ID / signal_scale, saturated at 10%. Signal scale is the larger of the absolute mean level and absolute peak-to-peak range, with a floor of 1e-12. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
repeatability.rms_intra_id
——not calculableNot enough information to score this metric on this dataset.Positioningmedian RMS distance to repeated-sample centroidalert = RMS_intra_ID / signal_scale, saturated at 10%
RepeatabilitySAM intra-ID
?Within-ID spectral angle to the group's mean spectrum, in radians. Repeated IDs require documentation before this spread can be called technical repeatability. Scoring: alert = min(1, SAM_intra_ID / 0.15 rad). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
repeatability.sam_intra_id
——not calculableNot enough information to score this metric on this dataset.Acquisitionmedian SAM to repeated-sample centroidalert = min(1, SAM_intra_ID / 0.15 rad)
RepeatabilityCV intra-ID
?Within-ID coefficient of variation: standard deviation relative to absolute mean; unstable near zero signal. Repeated IDs require documentation before this spread can be called technical repeatability. Scoring: alert = min(1, CV_intra_ID / 0.25). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
repeatability.cv_intra_id
——not calculableNot enough information to score this metric on this dataset.Operatormedian within-ID band CValert = min(1, CV_intra_ID / 0.25)
Structure of the datasetPCA score density
?Inverse median distance to nearby observations in retained PCA-score space. Larger raw values mean more closely spaced observations; scale depends on the PCA representation. The alert uses density variation, so raw density alone does not establish an anomaly. Scoring: alert follows density_cv/profile structure complexity, not raw density alone. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
structure.pca_score_density
0.063690.67mediumSubpopulationsDifferent batches1 / median kNN distance in PCA score spacealert follows density_cv/profile structure complexity, not raw density alone
Structure of the datasetkNN distance ratio (not LOF)
?95th percentile of mean k-nearest-neighbor distance divided by the population median of that distance, in PCA-score space. Values above 1 indicate an upper tail with more isolated observations; valid rare spectra can also be isolated. This distance ratio is not the Local Outlier Factor algorithm. Scoring: alert = min(1, max(0, kNN_distance_ratio_p95 - 1) / 2). Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
structure.knn_distance_ratio_p95
2.0160.51mediumIsolated spectrumRare casesp95(mean kNN distance / median population mean kNN distance) in PCA-score space; not LOFalert = min(1, max(0, kNN_distance_ratio_p95 - 1) / 2)
Structure of the datasetIsolation Forest score
?95th percentile of the negated Isolation Forest score in retained PCA-score space. Larger raw scores indicate easier isolation under that model; the scale is implementation-dependent. The displayed alert reuses structure complexity rather than directly mapping this raw score. Scoring: alert follows structure complexity; raw score is implementation-dependent. Higher alert scores indicate stronger heuristic concern, not a fault probability or an acceptance decision. A dash means unavailable.
structure.isolation_forest_score_p95
0.594850.67mediumAtypical spectrumVarious causesp95 IsolationForest anomaly score on PCA scoresalert follows structure complexity; raw score is implementation-dependent

PCA score plot — explore spectral variation

Source bhi2018_plot_spectra: 80 of 80 source observations are plotted. PC1 captures 85.9% and PC2 10.1% of the reported spectral variance: 96.0% together; 4.0% remains outside this view.

Principal component analysis (PCA) summarizes spectral differences without using targets. The horizontal PC1 axis captures the largest variation; vertical PC2 captures the next largest direction of variation. Each dot is one observation; repeated measurements need not be distinct samples. Scores are projection coordinates, not wavelengths or target values. Nearby dots have similar projections; separate groups or isolated dots are leads to inspect in the original spectra and acquisition metadata. Overlapping dots can differ in omitted dimensions. The dots have no class or batch labels, so this view cannot identify groups, confirm defective observations, explain a chemical cause or measure prediction accuracy.

bhi2018_plot_spectra PCA score plot-200-1000100200-50050100PC1 -37.92 · PC2 -16.52PC1 46.61 · PC2 -15.28PC1 -55.11 · PC2 36.28PC1 63.99 · PC2 10.91PC1 -72.49 · PC2 32.52PC1 39.03 · PC2 13.36PC1 -25.34 · PC2 21.5PC1 48.36 · PC2 -6.267PC1 -42.71 · PC2 -10.76PC1 111.9 · PC2 22.62PC1 40.35 · PC2 13.74PC1 -28.79 · PC2 -15.73PC1 49.86 · PC2 1.777PC1 111.2 · PC2 47.36PC1 -50.69 · PC2 -20.37PC1 26.57 · PC2 -16.3PC1 -72.46 · PC2 -10.41PC1 -114 · PC2 -3.671PC1 -12.48 · PC2 -27.48PC1 -51.01 · PC2 2.031PC1 -31.52 · PC2 -24.31PC1 -53.05 · PC2 -12.96PC1 -64.12 · PC2 -15.15PC1 -1.059 · PC2 -9.046PC1 81.87 · PC2 -23.26PC1 6.052 · PC2 -19.7PC1 -58.03 · PC2 -8.543PC1 -45.7 · PC2 -6.38PC1 -108 · PC2 -1.266PC1 -32.51 · PC2 -18.98PC1 -40.17 · PC2 -10.35PC1 -113.8 · PC2 7.031PC1 -42.66 · PC2 -8.675PC1 -67.67 · PC2 -7.037PC1 -38.55 · PC2 -1.026PC1 -18.64 · PC2 -12.12PC1 72.49 · PC2 -33.88PC1 -1.591 · PC2 -15.5PC1 -30.33 · PC2 -8.725PC1 -72.02 · PC2 -2.246PC1 -59.33 · PC2 8.901PC1 -32.54 · PC2 -18.25PC1 17.99 · PC2 -8.147PC1 -12.06 · PC2 -16.28PC1 37.28 · PC2 -3.006PC1 -42.43 · PC2 -8.642PC1 -108.7 · PC2 11.88PC1 -15.89 · PC2 -15.55PC1 -44.3 · PC2 -2.595PC1 -22.57 · PC2 -2.113PC1 -37.15 · PC2 3.516PC1 -39.89 · PC2 -5.482PC1 -18.02 · PC2 -9.751PC1 20.09 · PC2 -22.16PC1 17.73 · PC2 0.008256PC1 92.77 · PC2 -2.501PC1 85.08 · PC2 -22.75PC1 -67.66 · PC2 23.32PC1 64.33 · PC2 0.8136PC1 45.39 · PC2 -8.282PC1 94.24 · PC2 -25.69PC1 76.67 · PC2 -25.48PC1 16.22 · PC2 -5.49PC1 72.46 · PC2 -25.7PC1 -50.52 · PC2 3.346PC1 -91.08 · PC2 26.15PC1 -52.71 · PC2 72.19PC1 9.83 · PC2 28.85PC1 2.769 · PC2 29.36PC1 -6.134 · PC2 18.53PC1 97.74 · PC2 -10.93PC1 90.5 · PC2 -23.26PC1 60.68 · PC2 45.43PC1 75.98 · PC2 33.49PC1 99.9 · PC2 0.7728PC1 33.02 · PC2 49.22PC1 67.7 · PC2 11.98PC1 62.78 · PC2 9.006PC1 100.7 · PC2 26.15PC1 43.35 · PC2 31.95PC1 (85.9%)PC2 (10.1%)80 scores
View plotted PCA coordinates

Point numbers identify rows in this displayed coordinate list, not original observation or sample IDs. Non-integer coordinates use up to five significant digits. Original IDs, component loadings, preprocessing details and the observation selection method are not supplied with this plot.

Plotted observation positions (not original sample IDs)
PointPC1 scorePC2 score
1-37.922-16.524
246.609-15.28
3-55.11136.28
463.98910.911
5-72.48632.519
639.03213.363
7-25.33921.496
848.363-6.267
9-42.714-10.761
10111.9322.618
1140.34713.737
12-28.788-15.726
1349.8561.7772
14111.1847.356
15-50.689-20.37
1626.574-16.303
17-72.457-10.408
18-113.98-3.6711
19-12.479-27.481
20-51.012.0308
21-31.518-24.307
22-53.052-12.96
23-64.117-15.153
24-1.0591-9.0457
2581.873-23.258
266.0522-19.697
27-58.032-8.5431
28-45.704-6.3795
29-108.03-1.2663
30-32.506-18.976
31-40.167-10.349
32-113.857.0311
33-42.657-8.6747
34-67.675-7.0373
35-38.548-1.026
36-18.638-12.116
3772.495-33.875
38-1.5912-15.504
39-30.332-8.7252
40-72.023-2.2456
41-59.3298.9009
42-32.536-18.252
4317.987-8.1473
44-12.063-16.282
4537.28-3.006
46-42.427-8.6419
47-108.7311.88
48-15.889-15.548
49-44.298-2.5953
50-22.565-2.1132
51-37.1543.5163
52-39.888-5.4816
53-18.025-9.7514
5420.093-22.162
5517.7310.0082557
5692.77-2.5008
5785.085-22.754
58-67.66223.317
5964.3320.8136
6045.387-8.2818
6194.238-25.688
6276.669-25.476
6316.219-5.4899
6472.465-25.7
65-50.5213.3464
66-91.07626.147
67-52.70972.194
689.829928.851
692.769229.363
70-6.133618.53
7197.739-10.928
7290.503-23.261
7360.68245.428
7475.98333.492
7599.90.77284
7633.01949.221
7767.711.984
7862.789.0057
79100.6626.149
8043.34731.949

PCA explained variance — how many dimensions?

Each bar reports the share of spectral variance explained by a component. Concentration in the first components indicates correlated wavelengths. This is not variance explained in the prediction target. This projection may use a different observation sample from the score plot.

PCA explained variance0%25%50%75%100%PC1: 85.9% (cumulative 85.9%)1PC2: 10.1% (cumulative 96.0%)2PC3: 2.7% (cumulative 98.7%)3PC4: 0.5% (cumulative 99.2%)4PC5: 0.3% (cumulative 99.5%)5PC6: 0.2% (cumulative 99.7%)6PC7: 0.1% (cumulative 99.8%)7PC8: 0.1% (cumulative 99.8%)8PC9: 0.0% (cumulative 99.9%)9PC10: 0.0% (cumulative 99.9%)10cumulative explained variancePC variancecumulativeprincipal component · cumulative (dashed)
View explained variance values
Variance per displayed principal component
ComponentSpectral variance
PC185.89%
PC210.10%
PC32.70%
PC40.48%
PC50.34%
PC60.15%
PC70.09%
PC80.07%
PC90.04%
PC100.03%
X-Y spectral correlation 3

Pearson r measures the linear association between each spectral channel (X) and a numeric target (Y), from −1 to +1. The table reports peak and average absolute correlation and the share of channels with |r| ≥ 0.5. These are in-dataset associations, not validation scores or proof of causation.

Spectral association with lignin

Read Pearson correlation (−1 to +1) along the spectral axis (nm); the solid curve shows |r| and the dashed curve shows signed r.

X · lignin spectral correlation-1-0.500.51absolute correlation envelopesigned correlationabsolute correlation05001,0001,5002,0002,500|r|signed raxis · Pearson correlation scale

Spectral association with lma_g_m2

Read Pearson correlation (−1 to +1) along the spectral axis (nm); the solid curve shows |r| and the dashed curve shows signed r.

X · lma_g_m2 spectral correlation-1-0.500.51absolute correlation envelopesigned correlationabsolute correlation05001,0001,5002,0002,500|r|signed raxis · Pearson correlation scale

Spectral association with nitrogen

Read Pearson correlation (−1 to +1) along the spectral axis (nm); the solid curve shows |r| and the dashed curve shows signed r.

X · nitrogen spectral correlation-1-0.500.51absolute correlation envelopesigned correlationabsolute correlation05001,0001,5002,0002,500|r|signed raxis · Pearson correlation scale
Targetmax |r|axis @ maxmean |r||r| ≥ .5
lignin0.5917200.2874.8%
lma_g_m20.6445410.3118.6%
nitrogen0.4426820.1710.0%

Metric interpretation reference

Definitions, formulas and possible explanations for the reported values. A possible cause requires verification against acquisition records. Reading guide

Metric catalog 30

Look up each measured quantity, its calculation and the heuristic alert mapping before interpreting a high or low value.

FamilyMetricWhat it measuresHigher values suggestLower values suggestPossible causesCalculation / score
Data integrityInvalid/masked cell count (owner report)Null or masked cells in the evaluated populationTo investigateComplete according to the declared maskMissing data or validity mask; not evidence of an acquisition causeNative Preflight count of cells unavailable under x/null and valid_mask; denominator stays in native_metric.denominators.n_cells. Not legacy NaN ratio.
Data integrityNaN ratioMissing dataCorrupted spectrumFull spectrumAcquisition/export errorcount(isnan(X)) / X.sizealert = min(1, nan_ratio / 0.05)
Data integrityInf countInfinite valuesCorruptionNormalInvalid calculationscount(isinf(X))alert = min(1, inf_count / 1)
Data integrityZero ratioNull columns or cellsTruncated spectrumNormalExport, saturationcount(X == 0) / count(finite X)alert = min(1, zero_ratio / 0.05)
Overall amplitudeMean reflectanceAverage levelToo light / background visibleToo darkBackground, geometrymean(X finite)alert reuses baseline/shape drift because absolute reflectance ranges are technology-dependent
Overall amplitudeArea under curveOverall intensityIllumination differenceNormalProbe distancetrapezoid(mean_spectrum, spectral_axis)alert reuses baseline/shape drift because area scale depends on axis and units
Overall amplitudePeak-to-peak (PTP)Dynamic rangeStrong variabilityFlat spectrumSaturationmax(mean_spectrum) - min(mean_spectrum)alert increases when dynamic range is abnormally flat
Overall amplitudeVarianceSpectral variabilityNormal or heterogeneousFlat spectrumBad contactvar(X finite)alert increases when variance/dynamic range is abnormally flat
NoiseRoughness sigma proxyHigh frequency noiseNoisyStableLamp, detectormedian MAD(second derivative) * 1.4826 / sqrt(6)alert = noise_rms / signal_scale, saturated at 5%
NoiseRoughness S/N proxySignal qualityGood signalBad signalAcquisitionmean(abs(X)) / noise_rmsalert decreases with SNR dB; >=40 dB is treated as low alert
NoiseBandwise roughness S/N proxyLocalized noiseReliable zoneProblem areaDetectormin(abs(mean_spectrum) / local second-derivative noise)alert decreases with worst-band SNR dB; >=35 dB is treated as low alert
Local artifactsSpike countNarrow peaksArtifactsClean spectrumCosmic rays, splicecount robust outliers in second derivativealert follows spike_rate, saturated at 1%
Local artifactsSpike ratePeak densitySuspicious spectrumNormalInterpolationspike_count / (n_samples * (n_features - 2))alert = min(1, spike_rate / 0.01)
Local artifactsJump countDiscontinuitiesDetector connectionContinuousSplicecount robust outliers in first derivativealert follows jump_rate, saturated at 1%
Local artifactsJump rateJump frequencySpectral problemNormalCalibrationjump_count / (n_samples * (n_features - 1))alert = min(1, jump_rate / 0.01)
Local artifactsClip fractionSaturationClippingNormalDetector saturatedfraction of finite cells equal to repeated min/max extremaalert = min(1, clip_fraction / 0.01)
Spectral formBaseline slopeOverall slopeDriftStableIlluminationlinear slope of mean_spectrum over normalized axisalert = abs(slope / signal_scale), saturated at 0.5
Spectral formCurvature RMSCurvatureUnusual shapeSmoothBackground, splicemedian RMS(second derivative per spectrum)alert = curvature_rms / signal_scale, saturated at 1%
Spectral formD1 RMSLocal variabilityStructured spectrumFlatBiology or artifactmedian RMS(first derivative per spectrum)alert = d1_rms / signal_scale, saturated at 5%
Multivariate outliersPCA Q (SPE)Not explained by PCAAtypical spectrumCompliantArtifact, mixturep95(Q/SPE residual) / median(Q/SPE residual)alert = min(1, pca_q_ratio / 8)
Multivariate outliersHotelling T²Extreme in PCAExtreme but consistentCentralNatural variabilityp95(Hotelling T2) / median(Hotelling T2)alert = min(1, hotelling_t2_ratio / 8)
Multivariate outliersMahalanobis HDistance to cloudGlobal outlierNormal populationDifferent domainp95(sqrt(T2)) / median(sqrt(T2))alert = min(1, mahalanobis_h_ratio / 4)
Comparison to average spectrumRMS to mean spectrumAverage distanceDifferent spectrumTypicalDomain shiftp95 RMS distance to dataset mean spectrumalert = RMS_p95 / signal_scale, saturated at 25%
Comparison to average spectrumSpectral Angle Mapper (SAM)Difference in shapeDifferent shapeSimilarBackground, geometryp95 spectral angle to dataset mean spectrumalert = min(1, SAM_p95 / 0.35 rad)
RepeatabilityRMS intra-IDReproducibilityPoor repeatabilityStablePositioningmedian RMS distance to repeated-sample centroidalert = RMS_intra_ID / signal_scale, saturated at 10%
RepeatabilitySAM intra-IDShape variationUnstableStableAcquisitionmedian SAM to repeated-sample centroidalert = min(1, SAM_intra_ID / 0.15 rad)
RepeatabilityCV intra-IDInternal variabilityBad controlStableOperatormedian within-ID band CValert = min(1, CV_intra_ID / 0.25)
Structure of the datasetPCA score densityClustersSubpopulationsHomogeneousDifferent batches1 / median kNN distance in PCA score spacealert follows density_cv/profile structure complexity, not raw density alone
Structure of the datasetkNN distance ratio (not LOF)Local anomalyIsolated spectrumNormal populationRare casesp95(mean kNN distance / median population mean kNN distance) in PCA-score space; not LOFalert = min(1, max(0, kNN_distance_ratio_p95 - 1) / 2)
Structure of the datasetIsolation Forest scoreGlobal anomalyAtypical spectrumNormalVarious causesp95 IsolationForest anomaly score on PCA scoresalert follows structure complexity; raw score is implementation-dependent
Technology-specific extensions

Find measurement-specific checks and acquisition context that can help interpret a source's spectral patterns.

TechnologyAdaptations / metricsTarget anomaliesPractical guidance
UV-Vis 300-1000 nmBaseline, overall slope, drift at edges 300-350 and 900-1000; metrics by zonesStray light, bad white, saturation, weak signal at the endsThe edges are often unstable; also calculate edge/middle scores.
UV-Vis 300-1000 nmSaturation / clipping near max absorbance or max reflectanceSignal clippedVery important if strong absorption.
UV-Vis 300-1000 nmRed-edge, peak position, band ratios for vegetationBiological shift or optical artifactHelps distinguish real change from acquisition problem.
UV-Vis 300-1000 nmSmoothness / roughness indexHigh frequency noiseOften more informative than the SNR alone.
MIR / ATR-FTIRATR contact quality index: overall intensity, total area, depth of key bandsPoor crystal-sample contactCrucial: many anomalies come from the ATR contact.
MIR / ATR-FTIRCO2 / H2O atmospheric bandsBad atmospheric correctionFrequent spurious peaks.
MIR / ATR-FTIRBaseline curvature / rubber-band residualDiffusion, contact, baseline driftVery useful before PCA.
MIR / ATR-FTIRPeak position shiftBad spectral alignment/calibrationImportant in FTIR because small shifts count.
MIR / ATR-FTIRBand area ratios on known bandsChemically incoherent spectrumTo be adapted by matrix: polysaccharides, proteins, lipids, etc.
HS-MSTotal Ion Current (TIC), Base Peak Intensity (BPI)Weak injection, unstable ionizationMS equivalent of the global spectral level.
HS-MSNumber of peaks detectedPoor or too noisy spectrumToo little = bad signal; too much = noise/contamination.
HS-MSMass accuracy / m/z driftMass calibration problemFundamental in HRMS.
HS-MSRetention time drift if LC/GC-MSChromatographic driftMonitor on standards/QC pools.
HS-MSBlank contamination scoreContaminants / carry-overCompare samples vs blanks.
HS-MSInternal standard CVInstrumental variabilityVery robust if standards available.
HS-MSMissingness by featureDetection instabilityCrucial for filtering variables.
With repetitionsIntra-sample RMSOverall repeatabilityApplicable to all technologies.
With repetitionsSAM / intra-sample correlationShape repeatabilityVery useful for spectra.
With repetitionsIntra-sample CV per band / featureLocal repeatabilityDetects unstable areas.
With repetitionsICC or variance componentsShare of sample vs. technical varianceVery useful if several repetitions per sample.
With repetitionsDistance to intra-ID centroidAberrant repetitionAllows you to flag the bad repetition rather than the entire sample.
Bug-hunting / supervised audits

Review suggested follow-up methods for suspected data issues and whether their results are available in this explorer.

Potential issue familySuggested methodsWhat it detectsExplorer availability
Global spectral shiftInter-dataset average spectrum correlation, DTW, cross-correlation, comparison of peak positionsWavelength shift, misalignment, different interpolationPartially calculated: cross-correlation lag and dispersion of peak positions vs. average spectrum.
Baseline / offset / gainRegression each spectrum vs average spectrum: x = a + b ref + residual; followed by a, b, residual RMSAdditive offset, multiplicative effect, baseline driftCalculated in reference.affine_*.
Row mixing / X-M-Y mismatchIndex check, row hash, ID duplication, intra-ID spectral distance, inconsistent labelsMixed up rows, misaligned metadata, Y assigned to wrong spectrumPartially covered by intra-ID repeatability; checks index/hash to add to the canonical pipeline.
Information leak / poorly split repetitionsGroupKFold by sample_id vs StratifiedKFold random; auditing partitions by sample_idArtificially good performance due to repetitionsRequires splits and benchmark model; not calculated by the descriptive card.
Label bugsClose samples in X but different Y, confident learning, systematic FP/FN errorsInverted Y, input errors, ambiguous classesRequires Y and/or model; recommended for supervised explorer.
Hidden subdomainsPCA/UMAP/t-SNE + unsupervised clustering + association with dataset/Y/date/operatorBatches, campaigns, probes, backgrounds not providedPartially calculated by PCA and distance ratio kNN (not LOF); UMAP/t-SNE outside the static card.
Unknown localized artifactsWavelength x dataset map: mean difference, variance difference, KS per wavelengthUnanticipated anomalous spectral regionsTo be calculated at the bank level when several datasets share a spectral axis.
Instrumental breaksDiscontinuities in derivatives, changepoint detectionSplice, detector connection, local jump not providedCalculated by jump/spike rates; more advanced changepoint to add.
Spectral mixing/contaminationNMF / unmixing / reconstruction by convex hullExternal component: background, plastic, soilNot calculated automatically; requires component assumptions or large library.
Unstable but predictive featuresModel importance vs. QC instability by variableModel that learns an artifact rather than a biological signalRequires supervised model; recommended for benchmark reporting.

Curated scientific variables

Scientific roles derived from the source contract. M denotes experimental metadata; Y denotes informative response variables. Reading guide

9 experimental metadata fields (M) · 3 informative targets (Y).

VariableRoleDistinct valuesCompleteRange / balance
plot__plot_numM80100%2 – 235
sample_dateM29100%IR 5
image_dateM8100%IR 1.375
genusM7100%IR 6.5
speciesM10100%IR 7
usda_species_codeM10100%IR 7
common_nameM10100%IR 7
latitudeM80100%43.65 – 43.65
longitudeM80100%-89.8 – -89.79
ligninY80100%2.445 – 23.22
lma_g_m2Y80100%38.37 – 147.7
nitrogenY80100%0.6096 – 4.69

Identifiers and sampling groups remain available separately. Statistics count exported observations.

Variables

Declared prediction targets and recorded metadata, with distributions and missing-value counts. Identifiers are not automatically prediction targets. Reading guide

Targets 3

lignin

target · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

lignin distribution05102.445 – 3.31: 23.31 – 4.176: 04.176 – 5.042: 45.042 – 5.907: 15.907 – 6.773: 26.773 – 7.638: 17.638 – 8.504: 78.504 – 9.369: 39.369 – 10.23: 710.23 – 11.1: 611.1 – 11.97: 911.97 – 12.83: 212.83 – 13.7: 913.7 – 14.56: 714.56 – 15.43: 115.43 – 16.29: 216.29 – 17.16: 417.16 – 18.02: 318.02 – 18.89: 118.89 – 19.76: 319.76 – 20.62: 320.62 – 21.49: 221.49 – 22.35: 022.35 – 23.22: 10102030
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
12.31 ± 4.62
Median
?50th percentile: half the non-missing values lie at or below it.
11.71
Range
?Smallest and largest recorded non-missing values.
2.445 – 23.22
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
0.375
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
0.13 / -0.32
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
yes

lma_g_m2

target · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

lma_g_m2 distribution051038.37 – 42.92: 142.92 – 47.48: 147.48 – 52.04: 352.04 – 56.6: 156.6 – 61.15: 161.15 – 65.71: 265.71 – 70.27: 370.27 – 74.82: 374.82 – 79.38: 1079.38 – 83.94: 783.94 – 88.49: 888.49 – 93.05: 593.05 – 97.61: 597.61 – 102.2: 8102.2 – 106.7: 10106.7 – 111.3: 4111.3 – 115.8: 2115.8 – 120.4: 1120.4 – 124.9: 2124.9 – 129.5: 0129.5 – 134.1: 0134.1 – 138.6: 2138.6 – 143.2: 0143.2 – 147.7: 11020501002005001,000
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
89.44 ± 20.5
Median
?50th percentile: half the non-missing values lie at or below it.
89.27
Range
?Smallest and largest recorded non-missing values.
38.37 – 147.7
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
0.23
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
0.047 / 0.48
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
yes

nitrogen

target · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

nitrogen distribution0510150.6096 – 0.7796: 20.7796 – 0.9496: 20.9496 – 1.12: 11.12 – 1.29: 11.29 – 1.46: 21.46 – 1.63: 61.63 – 1.8: 61.8 – 1.97: 51.97 – 2.14: 72.14 – 2.31: 42.31 – 2.48: 122.48 – 2.65: 72.65 – 2.82: 82.82 – 2.99: 82.99 – 3.16: 33.16 – 3.33: 33.33 – 3.5: 13.5 – 3.67: 03.67 – 3.84: 13.84 – 4.01: 04.01 – 4.18: 04.18 – 4.35: 04.35 – 4.52: 04.52 – 4.69: 10246
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
2.281 ± 0.704
Median
?50th percentile: half the non-missing values lie at or below it.
2.344
Range
?Smallest and largest recorded non-missing values.
0.6096 – 4.69
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
0.309
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
0.059 / 1
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
yes

Metadata 16

plot_id

metadata · categorical

Compare recorded category counts and class balance. No distribution plot is available; use the recorded statistics below.

n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Classes
?Number of distinct recorded category values.
80
Balance (entropy)
?Normalized Shannon entropy, from 0 for one dominant class to 1 for equal class frequencies.
1
Imbalance ratio
?Largest class count divided by smallest class count; 1 indicates equal counts.
1
Top class
?Most frequent recorded category and its observation count.
bhi2018_p002 (1)

plot_num

metadata · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

plot_num distribution05102 – 11.71: 711.71 – 21.42: 521.42 – 31.12: 831.12 – 40.83: 540.83 – 50.54: 850.54 – 60.25: 360.25 – 69.96: 769.96 – 79.67: 779.67 – 89.38: 789.38 – 99.08: 1099.08 – 108.8: 1108.8 – 118.5: 0118.5 – 128.2: 0128.2 – 137.9: 0137.9 – 147.6: 0147.6 – 157.3: 0157.3 – 167: 0167 – 176.8: 0176.8 – 186.5: 0186.5 – 196.2: 0196.2 – 205.9: 0205.9 – 215.6: 0215.6 – 225.3: 4225.3 – 235: 80100200300
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
80.3 ± 68.4
Median
?50th percentile: half the non-missing values lie at or below it.
65.5
Range
?Smallest and largest recorded non-missing values.
2 – 235
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
0.852
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
1.3 / 0.75
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
no

sample_date

metadata · categorical

Compare recorded category counts and class balance. Bar lengths show observations in each displayed category.

sample_date classes2018051820180518: 552018060720180607: 552018070320180703: 552018051720180517: 442018060520180605: 442018072720180727: 442018081420180814: 442018091120180911: 332018070220180702: 332018062920180629: 33+10 more+10 more: 2727
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Classes
?Number of distinct recorded category values.
29
Balance (entropy)
?Normalized Shannon entropy, from 0 for one dominant class to 1 for equal class frequencies.
0.97
Imbalance ratio
?Largest class count divided by smallest class count; 1 indicates equal counts.
5
Top class
?Most frequent recorded category and its observation count.
20180518 (5)

dbh_m

metadata · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

dbh_m distribution05100.319 – 0.3544: 40.3544 – 0.3897: 00.3897 – 0.4251: 50.4251 – 0.4604: 50.4604 – 0.4958: 80.4958 – 0.5311: 30.5311 – 0.5665: 40.5665 – 0.6018: 90.6018 – 0.6372: 90.6372 – 0.6725: 60.6725 – 0.7079: 60.7079 – 0.7433: 40.7433 – 0.7786: 20.7786 – 0.814: 20.814 – 0.8493: 20.8493 – 0.8847: 30.8847 – 0.92: 10.92 – 0.9554: 30.9554 – 0.9907: 10.9907 – 1.026: 01.026 – 1.061: 01.061 – 1.097: 01.097 – 1.132: 01.132 – 1.168: 10.10.20.512510
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 2
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
0.6181 ± 0.171
Median
?50th percentile: half the non-missing values lie at or below it.
0.605
Range
?Smallest and largest recorded non-missing values.
0.319 – 1.168
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
0.276
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
0.64 / 0.43
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
no

image_date

metadata · categorical

Compare recorded category counts and class balance. Bar lengths show observations in each displayed category.

image_date classes2018060420180604: 11112018091020180910: 11112018062920180629: 11112018072520180725: 11112018081320180813: 11112018051620180516: 992018092620180926: 882018101720181017: 88
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Classes
?Number of distinct recorded category values.
8
Balance (entropy)
?Normalized Shannon entropy, from 0 for one dominant class to 1 for equal class frequencies.
1
Imbalance ratio
?Largest class count divided by smallest class count; 1 indicates equal counts.
1
Top class
?Most frequent recorded category and its observation count.
20180604 (11)

calcium

metadata · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

calcium distribution05100.02536 – 0.1602: 70.1602 – 0.2951: 40.2951 – 0.43: 60.43 – 0.5648: 100.5648 – 0.6997: 90.6997 – 0.8346: 70.8346 – 0.9694: 50.9694 – 1.104: 81.104 – 1.239: 21.239 – 1.374: 51.374 – 1.509: 31.509 – 1.644: 31.644 – 1.779: 11.779 – 1.914: 41.914 – 2.048: 12.048 – 2.183: 12.183 – 2.318: 12.318 – 2.453: 02.453 – 2.588: 02.588 – 2.723: 12.723 – 2.858: 02.858 – 2.992: 02.992 – 3.127: 13.127 – 3.262: 101234
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
0.9321 ± 0.678
Median
?50th percentile: half the non-missing values lie at or below it.
0.7981
Range
?Smallest and largest recorded non-missing values.
0.02536 – 3.262
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
0.727
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
1.2 / 1.9
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
no

phosphorus

metadata · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

phosphorus distribution05100.07227 – 0.08774: 40.08774 – 0.1032: 30.1032 – 0.1187: 50.1187 – 0.1342: 50.1342 – 0.1496: 90.1496 – 0.1651: 100.1651 – 0.1806: 70.1806 – 0.1961: 70.1961 – 0.2115: 30.2115 – 0.227: 70.227 – 0.2425: 20.2425 – 0.2579: 40.2579 – 0.2734: 60.2734 – 0.2889: 40.2889 – 0.3044: 10.3044 – 0.3198: 00.3198 – 0.3353: 10.3353 – 0.3508: 00.3508 – 0.3663: 00.3663 – 0.3817: 10.3817 – 0.3972: 00.3972 – 0.4127: 00.4127 – 0.4282: 00.4282 – 0.4436: 10.00.10.20.30.40.5
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
0.1865 ± 0.0691
Median
?50th percentile: half the non-missing values lie at or below it.
0.1746
Range
?Smallest and largest recorded non-missing values.
0.07227 – 0.4436
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
0.37
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
0.93 / 1.6
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
no

potassium

metadata · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

potassium distribution0510150.004003 – 0.1012: 50.1012 – 0.1984: 10.1984 – 0.2956: 30.2956 – 0.3928: 60.3928 – 0.49: 30.49 – 0.5872: 80.5872 – 0.6844: 40.6844 – 0.7816: 110.7816 – 0.8788: 40.8788 – 0.976: 50.976 – 1.073: 61.073 – 1.17: 71.17 – 1.268: 21.268 – 1.365: 41.365 – 1.462: 31.462 – 1.559: 31.559 – 1.656: 11.656 – 1.754: 01.754 – 1.851: 21.851 – 1.948: 01.948 – 2.045: 02.045 – 2.142: 02.142 – 2.24: 12.24 – 2.337: 10123
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
0.8451 ± 0.485
Median
?50th percentile: half the non-missing values lie at or below it.
0.777
Range
?Smallest and largest recorded non-missing values.
0.004003 – 2.337
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
0.573
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
0.6 / 0.48
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
yes

tot_phenolics

metadata · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

tot_phenolics distribution05102.456 – 3.199: 33.199 – 3.942: 93.942 – 4.685: 24.685 – 5.428: 75.428 – 6.171: 86.171 – 6.914: 66.914 – 7.656: 77.656 – 8.399: 48.399 – 9.142: 69.142 – 9.885: 29.885 – 10.63: 410.63 – 11.37: 411.37 – 12.11: 112.11 – 12.86: 112.86 – 13.6: 113.6 – 14.34: 114.34 – 15.09: 315.09 – 15.83: 015.83 – 16.57: 016.57 – 17.31: 317.31 – 18.06: 218.06 – 18.8: 418.8 – 19.54: 119.54 – 20.29: 10510152025
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
8.803 ± 4.74
Median
?50th percentile: half the non-missing values lie at or below it.
7.264
Range
?Smallest and largest recorded non-missing values.
2.456 – 20.29
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
0.539
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
0.89 / -0.26
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
no

chl_a_mmol_m2

metadata · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

chl_a_mmol_m2 distribution051024.19 – 46.35: 346.35 – 68.52: 068.52 – 90.68: 190.68 – 112.9: 2112.9 – 135: 1135 – 157.2: 3157.2 – 179.3: 3179.3 – 201.5: 2201.5 – 223.7: 1223.7 – 245.8: 5245.8 – 268: 2268 – 290.2: 3290.2 – 312.3: 4312.3 – 334.5: 6334.5 – 356.7: 2356.7 – 378.8: 1378.8 – 401: 5401 – 423.2: 7423.2 – 445.3: 10445.3 – 467.5: 6467.5 – 489.7: 5489.7 – 511.8: 5511.8 – 534: 1534 – 556.2: 20200400600
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
340 ± 134
Median
?50th percentile: half the non-missing values lie at or below it.
382.2
Range
?Smallest and largest recorded non-missing values.
24.19 – 556.2
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
0.394
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
-0.64 / -0.54
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
no

genus

metadata · categorical

Compare recorded category counts and class balance. Bar lengths show observations in each displayed category.

genus classesQuercusQuercus: 2626AcerAcer: 2626TiliaTilia: 77FraxinusFraxinus: 77BetulaBetula: 55CaryaCarya: 55PopulusPopulus: 44
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Classes
?Number of distinct recorded category values.
7
Balance (entropy)
?Normalized Shannon entropy, from 0 for one dominant class to 1 for equal class frequencies.
0.85
Imbalance ratio
?Largest class count divided by smallest class count; 1 indicates equal counts.
6
Top class
?Most frequent recorded category and its observation count.
Quercus (26)

species

metadata · categorical

Compare recorded category counts and class balance. Bar lengths show observations in each displayed category.

species classesrubrarubra: 1414americanaamericana: 1414saccharumsaccharum: 1414albaalba: 1212rubrumrubrum: 99cordiformiscordiformis: 55grandidentatagrandidentata: 44nigranigra: 33saccharinumsaccharinum: 33alleghaniensisalleghaniensis: 22
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Classes
?Number of distinct recorded category values.
10
Balance (entropy)
?Normalized Shannon entropy, from 0 for one dominant class to 1 for equal class frequencies.
0.92
Imbalance ratio
?Largest class count divided by smallest class count; 1 indicates equal counts.
7
Top class
?Most frequent recorded category and its observation count.
rubra (14)

usda_code

metadata · categorical

Compare recorded category counts and class balance. Bar lengths show observations in each displayed category.

usda_code classesQURUQURU: 1414TIAMTIAM: 1414ACSA3ACSA3: 1414QUALQUAL: 1212ACRUACRU: 99CACO15CACO15: 55POGR4POGR4: 44BENIBENI: 33ACSA2ACSA2: 33BEAL2BEAL2: 22
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Classes
?Number of distinct recorded category values.
10
Balance (entropy)
?Normalized Shannon entropy, from 0 for one dominant class to 1 for equal class frequencies.
0.92
Imbalance ratio
?Largest class count divided by smallest class count; 1 indicates equal counts.
7
Top class
?Most frequent recorded category and its observation count.
QURU (14)

common_name

metadata · categorical

Compare recorded category counts and class balance. Bar lengths show observations in each displayed category.

common_name classesRed oakRed oak: 1414American basswoodAmerican basswood: 1414Sugar mapleSugar maple: 1414White oakWhite oak: 1212Red mapleRed maple: 99Bitternut hickoryBitternut hickory: 55Bigtooth aspenBigtooth aspen: 44River birchRiver birch: 33Silver mapleSilver maple: 33Yellow birchYellow birch: 22
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Classes
?Number of distinct recorded category values.
10
Balance (entropy)
?Normalized Shannon entropy, from 0 for one dominant class to 1 for equal class frequencies.
0.92
Imbalance ratio
?Largest class count divided by smallest class count; 1 indicates equal counts.
7
Top class
?Most frequent recorded category and its observation count.
Red oak (14)

latitude

metadata · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

latitude distribution024643.65 – 43.65: 343.65 – 43.65: 143.65 – 43.65: 243.65 – 43.65: 243.65 – 43.65: 143.65 – 43.65: 143.65 – 43.65: 243.65 – 43.65: 343.65 – 43.65: 343.65 – 43.65: 343.65 – 43.65: 643.65 – 43.65: 443.65 – 43.65: 343.65 – 43.65: 543.65 – 43.65: 143.65 – 43.65: 443.65 – 43.65: 543.65 – 43.65: 543.65 – 43.65: 643.65 – 43.65: 643.65 – 43.65: 343.65 – 43.65: 443.65 – 43.65: 343.65 – 43.65: 443.645043.647543.650043.652543.6550
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
43.65 ± 0.00226
Median
?50th percentile: half the non-missing values lie at or below it.
43.65
Range
?Smallest and largest recorded non-missing values.
43.65 – 43.65
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
5.18e-05
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
-0.42 / -0.7
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
yes

longitude

metadata · numeric

Read the recorded value distribution and summary statistics; no measurement unit is recorded.

longitude distribution0510-89.8 – -89.8: 1-89.8 – -89.8: 0-89.8 – -89.8: 2-89.8 – -89.8: 2-89.8 – -89.8: 3-89.8 – -89.79: 3-89.79 – -89.79: 2-89.79 – -89.79: 3-89.79 – -89.79: 5-89.79 – -89.79: 2-89.79 – -89.79: 5-89.79 – -89.79: 9-89.79 – -89.79: 5-89.79 – -89.79: 4-89.79 – -89.79: 5-89.79 – -89.79: 3-89.79 – -89.79: 7-89.79 – -89.79: 2-89.79 – -89.79: 5-89.79 – -89.79: 5-89.79 – -89.79: 1-89.79 – -89.79: 2-89.79 – -89.79: 2-89.79 – -89.79: 2-89.800-89.795-89.790-89.785
n / missing
?Recorded observation count and number of missing values for this variable.
80 / 0
Mean ± SD
?Arithmetic mean and standard deviation in the variable's stated unit.
-89.79 ± 0.00256
Median
?50th percentile: half the non-missing values lie at or below it.
-89.79
Range
?Smallest and largest recorded non-missing values.
-89.8 – -89.79
CV
?Coefficient of variation: standard deviation divided by absolute mean; unstable when the mean is near zero.
2.85e-05
Skew / kurtosis
?Distribution asymmetry and excess kurtosis. A Gaussian distribution has skewness 0 and excess kurtosis 0.
-0.1 / -0.63
Normal?
?Descriptive normality-test result. A non-normal target is not automatically a defective variable.
yes
Constant metadata 14

Fields with one recorded value provide context for every observation; they have no distribution to compare.

  • SpectralRep1
  • veg_typetree
  • datasetEcoSIS
  • n_points_original187
  • dimensions1D
  • axis_notewavelengths_as_provided_by_EcoSIS_resource
  • official_data_urlhttps://data.ecosis.org/dataset/seasonal-canopy-spectra-and-traits--blackhawk-island--wi
  • official_package_urlhttps://ecosis.org/package/seasonal-canopy-spectra-and-traits--blackhawk-island--wi
  • licenseOpen Data Commons Public Domain Dedication and License (PDDL)
  • license_urlhttp://www.opendefinition.org/licenses/odc-pddl
  • rights_statusexplicit_open
  • usage_scopepublic_reuse_possible
  • public_release_allowedTrue
  • notesTask-specific EcoSIS target not present in active parent Y table, wavelengths kept as provided by EcoSIS resource, no project interpolation.

Alignment

How observations join to physical sample IDs. Multiple exported rows are not necessarily independent samples or technical repetitions. Reading guide

Alignment levelsample
Sample id availableyes
Samples80
Observations (total)80
Exported observations per unitmin 1 · mean 1 · max 1
Identity statusavailable
Documented technical repetitionsND
Source unitMultiplicity of the declared identifier; protocol not established

Splits

Partitions supplied by the original dataset. They are documented here and are not applied automatically when loading. Reading guide

No original partition summaries are recorded. Loading does not create a train/test split.

Load this dataset

Use the appropriate route below: an assembled dataset, original raw resources, or the documented access procedure. Reading guide

# pip install nirs4all-datasets
from nirs4all_datasets import get

ds = get("ecosis_seasonal_canopy_spectra_and_traits_blackhawk_island_wi_reflectance_nirs")            # DOI-pinned, checksum-verified, cached
X, y = ds.x(), ds.y()
print(X.shape, y.shape)
card.jsoncroissant.jsonIdentity metadata only — the dataset bytes live at the origin / DOI.

Read the documentation

Access and rights are separate

Start with provenance and governance at the top of a card. Provenance links to the original resources and publications. Governance records the license, redistribution conditions and content identity.

Open source access means an open original-source route is recorded. Restricted redistribution is the display label for the catalog's private tier: rights are restricted or not cleared for redistribution. It does not mean that the original source is necessarily private.

Raw reproducible identifies a retrieval route. Assembly incomplete means raw resources can be available while dataset-specific conversion is missing. The loading example uses retrieve(id, prepare=False) for these raw downloads; it returns resource metadata rather than X/Y arrays. A complete original-source recipe uses get(id). Two Harvard datasets require explicit guestbook answers.

Token required means no open automatic route is recorded. A Dataverse token works only once the canonical data have a configured hosted DOI. Manual access requires the original provider's documented steps. Availability labels describe the catalog routes, not a fresh live check of every URL.

Why is PCA on a dataset card?

Spectra have many correlated wavelengths. Principal component analysis (PCA) compresses their variation into a few orthogonal directions, called principal components (PCs). It is an exploratory summary of X, calculated without using the target Y.

The score plot places each plotted observation on PC1 and PC2. Nearby dots have similar projections; groups can reveal batches, instruments or natural subpopulations. Axis percentages show explained spectral variance. Large sources are sampled to at most 800 observations. Similar positions in two dimensions do not guarantee similar full spectra; an isolated dot does not prove an acquisition fault.

The scree plot reports spectral variance per component, helping you see whether variation is concentrated in a few dimensions. It is not explained target variance or predictive accuracy. The scree projection and score-plot projection may use different row samples; their percentages need not match.

Q / SPE measures residual variation outside the retained PCA subspace. Hotelling T² measures an observation's scaled distance within that subspace; Mahalanobis H summarizes PCA-space distance. The displayed p95/median ratios compare the distribution's upper tail with its center, without an absolute rejection threshold.

Historical profiles replace missing cells with column medians before PCA, center channels, and use bounded row/component counts. Loadings and distances depend on signal units and preprocessing. Compare compatible sources and inspect the original spectra before acting.

Scores, evidence and missing values

Read measured values first. An alert score maps selected metrics to a heuristic 0–1 scale. The display bands are weak below 0.42, medium from 0.42 to below 0.72, and strong from 0.72. They are not universally validated pass/fail thresholds.

The radar's center is 0 and its outer ring is 1: outward means a stronger anomaly or heterogeneity signal for that axis. Its table gives values rounded to two decimals and explains each axis. Missing axes are left blank; partial profiles have no filled polygon. The mean profile score averages only available axes and is not an overall quality grade.

Diagnostic bars rank possible explanations from heuristic signatures. A score of 0.78 does not mean a 78% causal probability. Evidence coverage is the proportion of required signals available, not confidence in the cause. A dash or “unavailable” means the quantity could not be computed; zero is an actual recorded value.

RMS (root mean square distance) and SAM (Spectral Angle Mapper, in radians) use this dataset's mean spectrum as their reference. They do not compare with an independently acquired white or dark reference. Repeated IDs require a documented protocol before within-ID spread can be called technical repeatability.

X–Y plots show Pearson correlation within this dataset. They identify linear associations; they are not cross-validated predictions and do not establish causal relationships. Targets, metadata, observation counts and physical sample counts have different meanings.