Talent.com
Ez az állásajánlat nem elérhető az országodban.
Senior Staff Engineer, Spark Team

Senior Staff Engineer, Spark Team

ClouderaRemote, Hungary
18 napja
Munkaköri leírás

Job Description

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

Cloudera is looking for a senior staff software engineer with strong distributed systems expertise to work on the Cloudera distribution of Apache Spark and Livy. We are looking for senior engineers with experience in large-scale, distributed systems and data processing to help build our enterprise-grade system, designed for customers running Spark on thousands of nodes and processing petabytes of data.

We are looking for a passionate individual excited about taking a product already supporting production systems at many of the biggest companies – and is looking to expand and take on even more projects to drive the next gen Data Engineering experience. You will be working with a distributed team, spread across the United States and Hungary, including multiple committers on Apache Spark.

As a Senior Staff Engineer, you will…

Design new features for Cloudera’s data engineering experience, and take them from prototypes to leading a team to deliver the feature in production at scale

Contribute to Apache Spark, Livy

Develop new features in Scala / Java / Python on a modern platforms

Gain expertise in distributed data processing, from SQL planners and optimizers, to data layout and table formats like Apache Parquet and Iceberg, to fault tolerance in distributed systems.

Gain a solid understanding and deep technical knowledge of components across the Cloudera Data Engineering Experience stack, but focusing on Iceberg and Spark, which you can utilize in your daily tasks

Get to work on large scale distributed systems, from 100s to 1000s of nodes, in production clusters

Debug system level deployment issues, root cause analysis, perform system test analysis and resolve failures

Work on improving internal infrastructure

Collaborate with other team members and stakeholders

We are excited if you have...

8-10+ years professional software development.

Experience leading and delivering complex product enhancements.

We use Java / Scala / Python in projects, you should have a strong understanding of at least one of the following languages : Java, Scala, Python. And interested to learn the languages we’re using.

Experience with systems design, development.

Passionate about programming, clean coding habits, attention to detail, and focus on quality

Strong oral and written communication skills.

Strong ability to research and solve problems independently without constant supervision

Most importantly) Open-minded, desire to learn new things and build great products.

Experience with distributed systems

You may also have...

Experience with SQL planners

Experience with using / developing Apache Spark, Livy or other related technologies.

Experience with large-scale, distributed systems design and development with an understanding of scaling, performance, and scheduling.

Solid experience with at least one cloud service (AWS, Azure, GCP, OpenShift)

Contributors to open-source projects.

What you can expect from us :

Generous PTO Policy

Support work life balance with

Flexible WFH Policy

Mental & Physical Wellness programs

Phone and Internet Reimbursement program

Access to Continued Career Development

Comprehensive Benefits and Competitive Packages

Employee Resource Groups

EEO / VEVRAA

LI-LL1

LI-REMOTE

Hozzon létre álláshirdetést erre a keresésre

Senior Engineer Team • Remote, Hungary

Kapcsolódó állás
Senior Backend Engineer @ Secret Sauce Partners, Inc.

Senior Backend Engineer @ Secret Sauce Partners, Inc.

Secret Sauce Partners, Inc.Remote, Hungary
We're looking for a Senior Frontend Engineer to grow our team where there's room for everyone to improve their core skills and also get better at mentoring and leadership.The Senior Frontend Engine...Mutass többetUtolsó frissítés: 4 napja
Software Engineer, Platform @ Speechify

Software Engineer, Platform @ Speechify

SpeechifyRemote, Hungary
A dynamic environment where your contributions shape the company and its products.A team that values innovation, intuition, and drive. Autonomy, fostering focus and creativity.The opportunity to hav...Mutass többetUtolsó frissítés: 30+ napja
QA Lead Engineer @ Dynata Hungary Kft.

QA Lead Engineer @ Dynata Hungary Kft.

Dynata Hungary Kft.Remote, Hungary
This is a technical role for the MarketSight team at Dynata.The successful candidate will be deeply involved in the production and support of the MarketSight application. Responsible for direct tech...Mutass többetUtolsó frissítés: 19 napja
Senior Test Automation Engineer @ Peak

Senior Test Automation Engineer @ Peak

PeakRemote, Hungary
At PEAK, we value creativity, teamwork, and professionalism.We believe in transparent and honest communication that creates a positive and productive work environment. Senior Test Automation Enginee...Mutass többetUtolsó frissítés: 28 napja
Senior Software Solution Engineer, Networking

Senior Software Solution Engineer, Networking

NVIDIARemote, Hungary
NVIDIA is widely considered to be one of the technology world’s most desirable employers.We have some of the most forward-thinking and hardworking people on the planet working for us.If you're crea...Mutass többetUtolsó frissítés: 30+ napja
Fullstack Software Team Lead @ Lucidreams

Fullstack Software Team Lead @ Lucidreams

LucidreamsRemote, Hungary
Team Lead - (Frontend & Backend) – Fintech Startup (Remote).We are an AI-driven fintech startup in stealth mode, building a powerful tool for finance managers in medium to large companies to tr...Mutass többetUtolsó frissítés: 28 napja
  • Új!
Mobile Automation Engineer

Mobile Automation Engineer

VerintRemote, Hungary
We are seeking a QA Automation Engineer with a strong experience in the full mobile automation lifecycle and a passion for quality. A successful candidate would join a motivated mobile application d...Mutass többetUtolsó frissítés: 2 órával ezelőtt
Staff Software Engineer (Remote) @ Skedda

Staff Software Engineer (Remote) @ Skedda

SkeddaRemote, Hungary
Skedda is a leading global booking management platform dedicated to streamlining venue and space reservations and scheduling. We serve over 7,000 customers and nearly two million users across the wo...Mutass többetUtolsó frissítés: 12 napja
Regulatory Manager / Senior Regulatory Manager

Regulatory Manager / Senior Regulatory Manager

Precision Medicine GroupRemote, Hungary
Precision for Medicine (CRO) are recruiting a Regulatory Manager to join our team, candidates can be based in the following countries : UK, Spain, Hungary, Slovakia, Serbia, Romania or Poland.The Re...Mutass többetUtolsó frissítés: 30+ napja
Java Developer - iLottery Industry @ Mito Digital

Java Developer - iLottery Industry @ Mito Digital

Mito DigitalRemote, Hungary
Here at Mito Digital, we love building clever things : apps, websites, and complex backend systems for lottery companies and aviation brands around the world. Now our lottery & betting team of 30...Mutass többetUtolsó frissítés: 19 napja
Senior Java Engineer - Mission Control Team @ Cision Hungary

Senior Java Engineer - Mission Control Team @ Cision Hungary

Cision HungaryRemote, Hungary
We are a team of passionate individuals deeply committed to doing our best, continuously learning, and supporting each other to grow and improve. Together, we take pride in the meaningful impact we ...Mutass többetUtolsó frissítés: 26 napja
Build System Engineer (Senior) @ VirtusLab

Build System Engineer (Senior) @ VirtusLab

VirtusLabRemote, Hungary
We are #VLteam – tech enthusiasts constantly striving for growth.The team is our foundation, that’s why we care the most about the friendly atmosphere, a lot of self-development opportunities and g...Mutass többetUtolsó frissítés: 9 napja
PHP Software Engineer (Hungarian speaking) @ Antavo Kft.

PHP Software Engineer (Hungarian speaking) @ Antavo Kft.

Antavo Kft.Remote, Hungary
Antavo is a rapidly growing VC-backed scale-up that is disrupting the loyalty management market through its innovative omnichannel technologies. We are recognized by Gartner and Forrester as a leadi...Mutass többetUtolsó frissítés: 9 napja
  • Új!
Senior Change Consultant (3-6 months engagement) @ CSHARK Sp. z o.o.

Senior Change Consultant (3-6 months engagement) @ CSHARK Sp. z o.o.

CSHARK Sp. z o.o.Remote, Hungary
We are looking for an experienced .IT Infrastructure and Operations area, for our client in the manufacturing industry.This role is not tied to a single initiative but covers a range of internal tr...Mutass többetUtolsó frissítés: 1 órája
  • Új!
Senior SAP ABAP + SAP CRM Developer @ Matrix Global Services

Senior SAP ABAP + SAP CRM Developer @ Matrix Global Services

Matrix Global ServicesRemote, Hungary
Matrix Eastern Europe, the offshore division of Matrix IT, one of the leading global R&D services companies with more than 11,000 professionals, is looking for a Senior SAP ABAP Developer to jo...Mutass többetUtolsó frissítés: 1 órája
TMF Specialist - Remote - FSP

TMF Specialist - Remote - FSP

ParexelRemote, Hungary
When our values align, there's no limit to what we can achieve.Parexel are currently recruiting for multiple Trial Master File Specialists (TMF Specialists) to support a key sponsor in EMEA, we are...Mutass többetUtolsó frissítés: 14 napja
Senior DevOps Engineer @ Peak Financal Services

Senior DevOps Engineer @ Peak Financal Services

Peak Financal ServicesRemote, Hungary
Join Peak – Where Innovation and Game-Changing Projects Thrive!.Why Peak? 🚀 Innovative Projects – Work on industry-defining projects in AI, data science, digital transformation, and more.Collabora...Mutass többetUtolsó frissítés: 16 napja
Senior Analytics Engineer (Power BI / Data Modelling / ELT Pipelines) @ Square One Resources

Senior Analytics Engineer (Power BI / Data Modelling / ELT Pipelines) @ Square One Resources

Square One ResourcesRemote, Hungary
Our client, a rapidly growing SaaS company, is seeking a .The goal is to empower business teams with high-quality, self-service analytics and data-driven insights to support strategic decision-maki...Mutass többetUtolsó frissítés: 2 napja