Principal Data Platform Engineer

Principal Data Platform Engineer

This role will be a contract to hire after 6 to 12 months

100% Remote

Due to the nature of the work/company, we are currently hiring GC or US Citizens.

They are really focusing in on PRINCIPAL level candidates, who bring that job title as well. so Principal level is very important. Also understanding how these systems are operated on the back-end (going beyond the day to day work and know the breath and the depth)

 

Need Databricks experience, wants candidates that can elaborate on tech skills

Required Skills: Strong cloud data engineer- Databricks, understanding of NoSQL architecture, preferably Cosmos but ok with Mongo or Cassandra, relational databases- SQL Server

 

 

This is an exciting opportunity for an experienced senior developer of large scale data solutions. You will join a team delivering a transformative next-gen cloud big data platform.

The ideal candidate will have a proven track record in designing & implementing real-time event data streaming, SQL & NoSQL data stores and transformation pipelines for large scale organizations. We are seeking someone with deep technical skills and fully hands on in a variety of technologies to play an important role in developing and delivering early proofs of concept and production implementation. The successful candidate will have hands-on experience in a multitude of data domains; including, but not limited to; 24 x 7 x 365 enterprise and cloud database infrastructure design and management, security, database design, database development, database tuning, service delivery, incident tracking, and change management.

Responsibilities

Executes design sessions to gather requirements, review, approve, and communicate design artifacts with stakeholders

Designing and implementing performant streaming and batch data movement pipelines using Databricks / ADF

Architecting and managing various data model associated with NoSQL DBs (Azure Cosmos, Cassandra, etc) and Relational DBs (MS SQL Server, PostgreSQL etc)

Ensures database features and capabilities are incorporated into data model designs to optimize performance, resiliency and scalability.

Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security policy.

Documents and communicates database design.

 

Qualifications

Bachelors degree in Computer Science or Engineering required. Masters degree preferred.

7+ years of overall software development and/or database engineering experience required

3+ years of hands-on development experience with Databricks & Python

3+ years of hands-on development experience with ADF

2+ years of hands-on development experience with event based streaming technologies (Apache Kafka / Azure Event Hub or similar)

2+ years of hands-on development experience with NoSQL DBs (Cassandra / Azure Cosmos DB or similar)

Strong knowledge and experience in coding Databricks python notebooks and dlt pipelines

Strong knowledge and experience in data modeling & design with relational and NoSQL DBs

Demonstrated expertise in performance tuning in various DB environments

Experience building and scaling distributed, highly available systems in cloud env (Azure / AWS)

Expertise in understanding complex business needs, analyzing, designing, and developing solutions

Communication and professional skills and the ability to establish relationships across business units

Experience working in a Dev/Ops environment with tools such as Microsoft Visual Studio Team Services, Chef, Puppet or Terraform

Boston Associate Software Systems LC is an E-Verify participating employer and provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, Boston Associate Software Systems LC complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. Boston Associate Software Systems LC expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of Boston Associate Software Systems LC’s employees to perform their job duties may result in discipline, including discharge.

Job Category: IT
Job Type: Contract
Job Location: Remote

Apply for this position

Allowed Type(s): .pdf, .doc, .docx
Cart

No products in the cart.

Select the fields to be shown. Others will be hidden. Drag and drop to rearrange the order.
  • Image
  • SKU
  • Rating
  • Price
  • Stock
  • Availability
  • Add to cart
  • Description
  • Content
  • Weight
  • Dimensions
  • Additional information
  • Attributes
  • Custom attributes
  • Custom fields
Click outside to hide the comparison bar
Compare