CodeXGLUE: CodeSearchNet, AdvTest
Code SearchCoding Lang: PythonBenchmark
The CodeXGLUE: CodeSearchNet, AdvTest dataset is a Coding Lang: Python code search resource from Husain et al. at 2019 comprising 280,634 examples.
📊 This dataset is used as an LLM benchmark. See model leaderboards →
About CodeXGLUE: CodeSearchNet, AdvTest
Given a natural language prompt, the task is to search source code that matches the natural language. To test the generalization ability of a model, function names and variables in test sets are replaced by special tokens.
Details
- Task
- Code Search
- Language
- Coding Lang: Python
- Format
- JSON
- Rows / instances
- 280,634
- Creator
- Husain et al.
- Year
- 2019