LLM Pre-Training Engineer @ E-Group ICT Software Zrt.

E-Group is an innovative deep-tech, high-tech mid-market company with a strong vision, a fast-growing and friendly atmosphere, and a dynamic team of experts working on next-generation, beyond-state-of-the-art, future-proof technologies in artificial intelligence core technology stack, payment transactions, and digital identification.

Since its foundation in 1993, E-Group has gained a strong track record of successful projects in the healthcare, financial, energy, and government sectors. As an active member of the European innovation ecosystem, it leads or participates in many top-tier projects each year with EU Institutions, European universities, companies, and financial institutions to apply the latest scientific advances to real customer needs.

We are looking for YOU if :

• The “impossible” for you is just another challenge
• You inspire your environment with your original way of thinking
• You want to be involved in world-class, professionally inspiring development projects

What We Offer :

If you know yourself from the description, then E-Group is the place for you.

We care about who you are, your goals, and what person you want to become. We offer a place where you can add value not only with your skills, but also with your personality.

We look forward to receiving your application with a photo CV

The ideal candidate can :

What we expect :

E-Group is an innovative deep-tech, high-tech mid-market company with a strong vision, a fast-growing and friendly atmosphere, and a dynamic team of experts working on next-generation, beyond-state-of-the-art, future-proof technologies in artificial intelligence core technology stack, payment transactions, and digital identification.

Since its foundation in 1993, E-Group has gained a strong track record of successful projects in the healthcare, financial, energy, and government sectors. As an active member of the European innovation ecosystem, it leads or participates in many top-tier projects each year with EU Institutions, European universities, companies, and financial institutions to apply the latest scientific advances to real customer needs.

We are looking for YOU if :

What We Offer :

If you know yourself from the description, then E-Group is the place for you.

We care about who you are, your goals, and what person you want to become. We offer a place where you can add value not only with your skills, but also with your personality.

We look forward to receiving your application with a photo CV

Design and implement tensor, pipeline, MoE and ZeRO-3 parallelism strategies for LLM models, Build real-time utilisation dashboards and autoscale GPU clusters (Slurm / Karpenter), Implement fault-tolerant checkpointing and rapid resume logic for spot-instance fleets] Requirements : PyTorch, FSDP, DeepSpeed, Megatron-Core, Data engineering, Petastorm, Ray Data, WebDataset, GPU, CUDA Additionally : Magánegészségügyi ellátás, Csoportos élet- és balesetbiztosítás, Training budget, International projects, Külföldi konferenciák, Flat structure, Barátságos csapat, Ingyenes kávé, tea, snack, Free parking, Mobiltelefon, Bike parking, Shower, Pihenő zóna, Startup atmosphere, Modern budai iroda, No dress code.