Database Developer - III Job at Compunnel, Inc., San Francisco, CA

YklNMGZ4K2VTTXJtNUtESm1LU1pKWDFzQnc9PQ==
  • Compunnel, Inc.
  • San Francisco, CA

Job Description

We are looking for a skilled Data Mesh Data Modeler with expertise in Databricks to join our team. The ideal candidate will be responsible for designing and implementing scalable and efficient data models within a data mesh architecture, ensuring reliable and efficient data processing while collaborating with cross-functional teams. You will leverage Databricks for various data engineering tasks, from data processing to orchestration, to meet the needs of our data-driven organization. Job Responsibilities: Design and implement scalable, efficient data models within a data mesh architecture, following principles such as domain-driven design and federated data governance. Work closely with data architects, engineers, and business stakeholders to translate business requirements into technical solutions. Communicate data model designs effectively to technical and non-technical teams. Leverage Databricks for data engineering tasks, including data processing, data validation, and data orchestration. Optimize data pipelines to ensure high performance, scalability, and efficient data processing. Implement data validation rules and quality checks to ensure data integrity and consistency Design, implement, and manage the lifecycle of data products within the Data Mesh architecture. Collaborate with other teams to build, manage, and monitor efficient data pipelines and data products. Required Skills: Experience in Data Mesh Architecture: Expertise in modeling data products and understanding the principles of data mesh, domain-driven design, and federated governance. Databricks Expertise: Strong hands-on experience with Databricks, including using Spark for large-scale data processing, validation, and orchestration. Programming Skills: Proficiency in SQL and Python for data processing, transformation, and validation. Data Pipeline Optimization: Experience in designing and optimizing data pipelines to ensure scalability, high performance, and efficient data flow. Data Integrity: Implementing robust data validation and quality checks to ensure data consistency and accuracy across systems. Collaboration: Strong ability to work closely with cross-functional teams, including business users, data architects, and engineers. Problem-Solving: Strong troubleshooting and problem-solving skills to ensure the efficiency and reliability of data systems. Preferred Skills: Experience in designing and managing the lifecycle of Data Products within a Data Mesh architecture. Familiarity with data governance practices and tools for managing data quality and compliance. Knowledge of cloud platforms like AWS, Azure, or GCP for deploying and managing data solutions. Certifications: Databricks Certification or other relevant data engineering certifications are a plus. #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

Alyeska Resort

Lead Cook Job at Alyeska Resort

 ...Do Create complete meals , individual dishes, and specialized meals, considering dietary restrictions and allergies. Maintain food quality , portion sizes, and determine food proportions for consistently excellent dishes. Work independently with minimal... 

Lark Medical Staffing

Travel Respiratory Therapist - 13 Week Contract Job at Lark Medical Staffing

 ...Job Description Lark Medical Staffing is seeking a travel Respiratory Therapist for a travel job in Monroe, Washington. Job Description & Requirements ~ Specialty: Respiratory Therapist ~ Discipline: Allied Health Professional ~ Start Date: ASAP ~ Duration... 

Preferred Healthcare Staffing

Travel Skilled Nursing Facility (SNF) Physical Therapy Assistant - $1,610 per week Job at Preferred Healthcare Staffing

 ...Preferred Healthcare Staffing is seeking a travel Skilled Nursing Facility (SNF) Physical Therapy Assistant for a travel job in Alamosa, Colorado. Job Description & Requirements ~ Specialty: Physical Therapy Assistant ~ Discipline: Therapy ~ Start Date: ASAP... 

WildChina 碧山

Inbound MICE Manager/Director Job at WildChina 碧山

WildChina Corporate Services is seeking leaders in the MICE travel industry to join its innovative team in Beijing or Shanghai.This...  ...passionate about developing and managing relationships with international travel agents and incentive houses to lead in WildChinas fastest... 

Roadmaster Group-Secured Land Trans

Class A Team Driver Job at Roadmaster Group-Secured Land Trans

 ...Job Description Hiring Hazmat TEAM Drivers $2,000 - $2,300/wk per cdl truck driver guaranteed ~ Make $100k a year annual bonuses...  ...of mind CDL Truck Driver Requirements ~ Verifiable Class A CDL ~ Minimum of 1 year of recent OTR experience ~ Tanker &...