ANTIMEME SYSTEMWORKS RESEARCH DIVISION DATASET AUDIT // V1.0_BUILD

NT-REVISED

All 18 tasks hold chr20/21 out of train and 0 of 38,822 test rows reuse a train sequence, reverse complement, locus or interval within their task. One near pair reaches 0.98 identity.

DOC: AM-DA-2026 // NT-REVISED REV 851F9946252E90C665CDB3CC3EEDB78F1F26197C 18 TASKS // 532,064 ROWS b4ph/nt-revised-audit
01

Coverage

Tasks
18
ALL FOLDERS
Rows
532,064
493,242 TRAIN // 38,822 TEST
Coordinates parsed
100%
532,064 OF 532,064
Chromosome intersection
0/18
TEST IS CHR20/21 ONLY
02

Per task

Within-task test rows

COUNTS // TEST ROWS
TaskTrainTest ExactseqLocus OverlapNear≥.98 Near≥.95Unionreport Chr∩
H2AFZ30,0003,0000000800
H3K27ac30,0001,6160000400
H3K27me330,0003,0000000600
H3K36me330,0003,0000000800
H3K4me130,0003,00000001200
H3K4me230,0002,1380000400
H3K4me317,4687760000100
H3K9ac23,2741,0040000300
H3K9me327,4388500000600
H4K20me130,0002,2700000500
enhancers30,0003,00000001300
enhancers_types30,0003,00000001300
promoter_all30,0001,5840001310
promoter_no_tata30,0001,3720000100
promoter_tata5,0622120000000
splice_sites_acceptors30,0003,0000000500
splice_sites_all30,0003,0000000700
splice_sites_donors30,0003,00000001400
ALL EXACT, REVERSE-COMPLEMENT, LOCUS AND OVERLAP COUNTS ARE ZERO // NEAR-TIER ROWS ARE REPEAT-LIKE PAIRS ON OTHER CHROMOSOMES
03

Finding

The README total (544,596) and the Hub listing (532,064) differ by exactly the H3K4me3 train deficit. Test counts match everywhere, and that file is internally balanced at 8,734 rows per class.

04

Method

Source
InstaDeepAI/nucleotide_transformer_downstream_tasks_revised
Revision
851f9946252e90c665cdb3cc3eedb78f1f26197c
Identity
SHA-256 over canonical sequences
Loci
strict name parse, interval tree per chromosome
Near tier
bottom-32 k-mer sketch, edlib infix alignment
Checks
28 tests, DuckDB 90 of 90
Reproduce
# from the dataset package
$ python src/acquire.py --work /workspace/nt-audit --pkg .
$ python src/preflight.py --work /workspace/nt-audit --pkg .
$ cat tasks.txt | xargs -P 6 -I{} python src/match_task.py --task {}
$ python src/aggregate.py && python src/verify.py
$ pytest tests -q