Understanding In-context Learning from Repetition

We are thrilled to announce that our paper has been accepted by ICLR 2024!!!

This repo contains the code for the paper Understanding In-context Learning from Repetition.

All codes are good to use. We are currently working to make it easier to use and will be updated soon.

Getting Started

Install dependencies.

python setup.py install

Run the test code for random two tokens.

bash run.sh

Citation

If you find this useful in your research, please consider citing:

@inproceedings{
yan2024understanding,
title={Understanding In-Context Learning from Repetitions},
author={Jianhao Yan and Jin Xu and Chiyu Song and Chenming Wu and Yafu Li and Yue Zhang},
booktitle={The Twelfth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=bGGYcvw8mp}
}