Ask HN: Knowledge/skills to develop and contribute to projects like Unsloth?

1 points by hedgehog0 8 hours ago

Hi everyone,

I am a Master student in math in Germany and will graduate recently, since I am also interested in programming and LLM, I have been following HN and subs like r/machinelearning and r/localllama for some time. I have been really impressed by projects such as Unsloth that could help people train and/or fine-tune on commercial-grade GPUs.

I also want to develop/contribute to projects such as Unsloth, however, I'm not sure what are the background knowledge or skill sets one should have to contribute. So I was wondering if you have any recommendations of resources and materials for learning more about (post-)training, fine-tuning, and general ML/LLM Ops?

Thank you a lot!

P.S.: I'm reading and working through the book "Hands-on Large Language Model", and I have a Macbook Pro but no NVDA GPUs.