πŸ“Š
Dataset

Eai Taxonomy Code W Dclm

by EssentialAI essentialai/eai-taxonomy-code-w-dclm
Free2AITools Nexus Index
28.6
S: Semantic 50

Query-time baseline · scored live at search

A: Authority 45
P: Popularity 57
R: Recency 9
Q: Quality 50
Tech Context
Vital Performance —
Data Integrity 28.6 FNI Score
- Size
- Rows
- Tokens
Dataset Information Summary
Entity Passport
Registry ID essentialai/eai-taxonomy-code-w-dclm
License odc-by
Provider huggingface
πŸ“œ

Cite this dataset

Academic & Research Attribution

BibTeX
@misc{hf_dataset_essentialai_eai_taxonomy_code_w_dclm,
  author = {EssentialAI},
  title = {Eai Taxonomy Code W Dclm Dataset},
  year = {2025},
  howpublished = {\url{https://huggingface.co/datasets/EssentialAI/eai-taxonomy-code-w-dclm}},
  note = {Accessed via Free2AITools.}
}
APA Style
EssentialAI. (2025). Eai Taxonomy Code W Dclm [Dataset]. Free2AITools. https://huggingface.co/datasets/EssentialAI/eai-taxonomy-code-w-dclm

πŸ”¬Technical Deep Dive

Full Specifications [+]

βš–οΈ Free2AITools Nexus Index V2.0

Semantic (S) 50

Query-time baseline · scored live at search

Authority (A) 45
Popularity (P) 57
Recency (R) 9
Quality (Q) 50

πŸ’¬ Index Insight

FNI V2.0 for Eai Taxonomy Code W Dclm: Authority (A:45), Popularity (P:57), Recency (R:9), Quality (Q:50). Semantic (S) is a query-time baseline scored live at search.

Free2AITools Nexus Index

Data Sources / Provenance

Open data Updated: Live data
⬇️
Downloads
85,383

🎯 Task Categories

text-generation

πŸ‘οΈ Data Preview

πŸ“Š

Row-level preview not available for this dataset.

Schema structure is shown in the Field Logic panel when available.

πŸ”— Explore Full Dataset β†—

🧬 Field Logic

🧬

Schema not yet indexed for this dataset.

Dataset Specification

πŸ’» EAI-Taxonomy Code w/ DCLM

πŸ† Website | πŸ–₯️ Code | πŸ“– Paper

A 564 billion token dataset of high-quality code curated from web data using taxonomy-based filtering.

🎯 Dataset Overview

This dataset is part of the Essential-Web project, which introduces a new paradigm for dataset curation using expressive metadata and simple semantic filters. Unlike traditional code datasets that require complex domain-specific pipelines, our approach leverages a 12-category taxonomy to efficiently identify and extract high-quality code data.

πŸ’‘ EAI-Taxonomy Code w/ DCLM (564B tokens): Documents targeting code that exhibit intermediate to advanced reasoning, combined with the DCLM classifier to filter for instruction-dense documents. Also includes mathematics content (51 - Mathematics) to match the scope of existing code datasets.

πŸ† Performance

Our taxonomy-based approach achieves competitive results with significantly less curation effort:

Dataset HumanEval+ MBPP+ MMLU-CS Curation Complexity
DCLM-baseline 28.0% 45.5% 32.0% General web filtering
OpenCoder FW 26.2% 45.8% 27.7% Complex domain pipeline
EAI-Taxonomy Code 27.4% 46.6% 29.0% Simple semantic filter
EAI-Taxonomy Code w/ DCLM 28.7% 45.0% 47.0% + DCLM classifier

Results show competitive code generation performance with a +46.8% improvement in computer science knowledge (MMLU-CS) compared to baseline.

πŸ” Key Findings

  • Code Generation: All datasets perform within statistical error on single-function generation benchmarks (HumanEval+, MBPP+)
  • Code Knowledge: Clear impact on general computer science knowle

Social Proof

HuggingFace Hub
85.4KDownloads
πŸ”„ Updated daily

Source summary: Based on Hugging Face metadata. Not a recommendation.

πŸ“Š FNI Methodology πŸ“š Knowledge Baseℹ️ Verify with original source

πŸ›‘οΈ Dataset Transparency Report

Technical metadata sourced from upstream repositories.

Open Metadata

πŸ†” Identity & Source

id
hf-dataset--essentialai--eai-taxonomy-code-w-dclm
slug
essentialai--eai-taxonomy-code-w-dclm
source
huggingface
author
EssentialAI
license
odc-by
tags
task_categories:text-generation, license:odc-by, size_categories:100m<n<1b, format:parquet, modality:text, library:datasets, library:dask, library:mlcroissant, library:polars, arxiv:2506.14111, region:us

πŸ“Š Engagement & Metrics

downloads
85,383
stars
0
forks
0

Data indexed from public sources. Updated daily.