Job Description
We are looking for an experienced Technical Architect / Senior Software Engineer to join Databricks’ Distributed Data Systems (DDS) team.
This role focuses on building large-scale, distributed, high-performance systems that power Databricks’ core data infrastructure. You will work on systems that handle massive volumes of data, run at cloud scale, and serve thousands of enterprise customers globally.
You will design, build, and scale services that are reliable, efficient, and easy for developers and customers to use.
The Impact You Will Have
You will work across multiple critical engineering domains and solve problems that span product design, backend systems, and cloud infrastructure.
Your work may include:
Distributed Systems & Platform Engineering
- Design and build large-scale distributed systems from the ground up
- Solve complex challenges involving service scalability, reliability, and performance
- Work on service architecture, workflow orchestration, and platform monitoring
Cloud Storage & Data Access
- Build high-performance services and client libraries for storing and accessing huge volumes of data
- Work with cloud storage platforms such as:
- AWS S3
- Azure Blob Storage
- Ensure data is stored and accessed efficiently, securely, and reliably
Scalable Services & Data Pipelines
- Build scalable backend services using technologies like:
- Scala
- Kubernetes
- Apache Spark™
- Databricks platform tools
- Develop systems that power pricing and usage infrastructure handling millions of cluster-hours per day
- Create product features that help customers:
- View platform usage
- Control costs
- Optimize performance
Teams You May Work With
The DDS (Distributed Data Systems) team works across several core technologies, including:
- Apache Spark™
- Data Plane Storage
- Delta Lake
- Delta Pipelines
- Performance Engineering
What We Are Looking For
Education
- Bachelor’s degree or higher in:
- Computer Science
- Engineering
- Or a related technical field
Experience
- 6+ years of production-level software engineering experience
- Strong experience in at least one of the following languages:
- Java
- Scala
- Python
- C++
- Experience building large-scale distributed systems
- Experience working with:
- SaaS platforms
- Service-Oriented Architectures (SOA or microservices)
- Experience with search platforms is a plus
Technical Skills
- Strong system design and architecture skills
- Ability to write high-quality, production-ready code
- Experience working with cloud infrastructure and data-intensive systems
- Understanding of performance, scalability, and reliability at scale
About Databricks Customers
More than 10,000 organizations worldwide rely on Databricks, including:
- Comcast
- Condé Nast
- Grammarly
- Over 50% of Fortune 500 companies
These organizations use the Databricks Data Intelligence Platform to unify data engineering, analytics, and AI.
Benefits
Databricks offers a comprehensive benefits package designed to support employee well-being.
Benefits vary by region. Full details are available at:
mybenefitsnow.com/databricks
Diversity & Inclusion
Databricks is committed to creating a diverse, inclusive, and welcoming workplace.
Hiring decisions are made without discrimination based on age, gender, ethnicity, disability, religion, sexual orientation, or any other protected characteristic.
Key Skills
Distributed Systems, Software Architecture, SaaS Platforms, Java, Scala, Python, C++, Cloud Storage, Apache Spark, Delta Lake, Kubernetes, System Design