Not compatible with llama 3 models

[WoutDeRijck]

Errors get thrown, but these are version incompatibilities, so these need to be updated.
It started with the error:
valueError: rope_scaling must be a dictionary with two fields, type and factor, got {'factor': 8.0, 'low_freq_factor': 1.0, 'high_freq_factor': 4.0, 'original_max_position_embeddings': 8192, 'rope_type': 'llama3'}

To reproduce

Steps to reproduce the behavior:

1. Download repo fill in the empty fields in the yaml file
2. Use model meta-llama/Llama-3.2-3B-Instruct
3. Run it

Expected behavior

It runs.

[WoutDeRijck]

Simply increasing the transformers version doesnt immediately work. So I was wondering which combination of versions might work