Job Title: Senior Data Engineer (Databricks & Cloud Analytics)
Location: Salt Lake City, Utah
Work Model: Hybrid – onsite and remote
Responsibilities
• Design, develop, and support enterprise data platforms, cloud analytics solutions, or large-scale data engineering initiatives.
• Work hands-on with Databricks, Apache Spark (PySpark), Python, SQL, and Scala to build scalable data pipelines and analytics solutions.
• Manage and implement Databricks ecosystem components, including Workspaces, Delta Lake, Unity Catalog, Delta Live Tables, Databricks SQL, MLflow, and Databricks Jobs.
• Optimize SQL queries and improve query performance through tuning and best practices.
• Design and implement ETL/ELT processes utilizing cloud platforms such as Azure Data Factory.
• Work with event streaming technologies like Apache Kafka and integrate enterprise applications via REST APIs and web services.
• Utilize Azure Data Lake Storage (ADLS Gen2) and other cloud storage solutions.
• Collaborate within Linux environments, including shell scripting and command-line utilities.
• Use source control tools like Git for collaborative development.
• Participate in Agile teams practicing Scrum, Kanban, or SAFe methodologies.
• Provide technical mentoring and leadership within data engineering teams.
Requirements
• Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field or equivalent professional experience.
• At least 6 years of experience designing and supporting enterprise data platforms or cloud data solutions.
• Extensive hands-on experience with Databricks, Apache Spark, Python, SQL, and Scala.
• Proven SQL development skills, including query optimization and performance tuning.
• Experience designing ETL/ELT solutions with cloud platforms such as Azure Data Factory.
• Knowledge of Kafka or similar event streaming systems.
• Familiarity with cloud data storage (Azure Data Lake Storage or equivalents).
• Proficiency using Git for version control.
• Experience working in Linux environments and scripting.
• Preferred: Infrastructure as Code (Terraform), CI/CD pipelines (Azure DevOps, GitHub Actions).
• Strong analytical and troubleshooting skills.
• Prior experience working in Agile methodologies.
• Ability to prioritize multiple tasks independently and mentor team members.
#M-
#LI-
Ref: #404-IT Pittsburgh
Senior Principal Systems Development EngineerOur customers' system requirements are usually highly complex. Bringing together hardware and software systems design, Systems Development Engineering operates at the very cutting edge of technology to meet them. We design and...
As Jimmy Johns General Manager, you are responsible for overseeing and managing the daily operations. Celebrating team successes and coaching for better performance. Setting expectations and providing clear and continuous feedback. Creating an upbeat positive atmosphere...
...Payrate: $15.15/hourly + Health Benefits + Referral Bonus Cleans or repairs product as per instructions using vacuum, brushes, or shampooer. Sorts and places carpet materials or items on racks, shelves, or in bins according to predetermined sequence such as size,...
...Grain Farm Equipment Operator (6084) Location: South Dakota JobNumber: 6084 Grain Farm Equipment Operator Position available on family owned 10,000 acre dryland small grain farm in North Central South Dakota. MUST be a good mechanic, able operate a variety of...
...deliveries. SNC has led thoughtful and disruptive change in the aerospace and defense industry for the past 60 years and now, we're... ...a mission to unite, explore and inspire. As a lead aerospace engineer, you will lead a team to research, design, develop, test, certify...