Sr. Data Engineer (Databricks/AWS/Python)

Sr. Data Engineer (Databricks/AWS/Python)

31 Dec 2023
Texas, Plano, 75094 Plano USA

Sr. Data Engineer (Databricks/AWS/Python)

VDart Inc is the leading global provider of digital solutions, products and talent management company providing digital technology solutions in Automotive, Manufacturing, Energy & Utilities and Healthcare Industries. Led by a strong global team located across 10 countries including USA, Canada, Mexico, Brazil, UK, Japan, Australia & India. We are currently accepting applications from staffing firms for our Preferred Partner Program, where we align niche staffing firms with specific verticals based on their strengths. To apply, please visit: ;/p>
Role: Sr. Data Engineer (Databricks/AWS/Python)
Plano, TX
Long Term Contract

Roles & Responsibilities:

  • Perform analysis, design, development, and configuration functions as well as define technical requirements for assignments of intermediate complexity.
  • Participate with a team to perform analysis, assessment and resolution for defects and incidents of intermediate complexity and escalate appropriately.
  • Work within guidelines set by the team to independently tackle well-scoped problems.
  • Seek opportunities to expand technical knowledge and capabilities.
  • Stand up data platforms, build out ETL pipelines, write custom code, interface with data stores, perform data ingestion, and build data models
  • Oversee data ingesting into enterprise data mining solutions
  • Ability to take ownership when necessary, acting with urgency, putting customers first, and looking into the future
  • Solid understanding of cloud technologies, enterprise level Data Strategy and Data Governance concepts
  • Familiarity with data visualization tools and methodologies is a plus
  • Development of data pipelines, in AWS, using all types of data sets along with Redshift
  • Strong familiarity and hands-on experience with Databricks, Data Factory, StreamSets
  • Experience in writing code in Python/Scala.

Experience & Qualifications:
  • 10+ years of experience in architecture, design, implementation, and analytics solutions
  • Hands on development Design and Develop applications using Databricks
  • Experience with Solutioning on AWS
  • Data Migration experience from other platforms to AWS
  • In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
  • Any programming language experience with SQL, Store procedures, Spark/Scala.
  • Strong understanding of Data Modeling and defining conceptual logical and physical data models.
  • Ability to design and demonstrate system Architecture with different environments
  • Ability to deal with both On-Premises and Cloud systems
  • Data Engineering experience
  • Experience working with ETL tools such as Databricks and Redshift
  • Experience coding in Python, and PySpark
  • Experience with Python SDLC tools (flake8, commitizen, CircleCI)
  • Comfortable working with APIs
  • Cloud experience, specifically working with AWS (ECS, Redshift)
  • Experience working with relational databases and SQL scripts.

Key Skills: Data Engineer, Databricks, AWS, Python, Data Modeling, ETL, PySpark

Referral Program: Ask our recruiting team about how you can be a part of our referral program. If you refer a candidate with the desired qualifications and your candidate accepts the role, you can earn a generous referral fee. We want to hire the best talent available and are committed to building great teams and partnerships.

We are Equal Employment Opportunity Employer.

VDart Inc
Alpharetta, GA
Follow us on Twitter for the hottest positions: @VDartJobs
Follow us on Twitter: @vdartinc

Related jobs

Job Details

  • ID
  • State
  • City
  • Job type
  • Salary
  • Hiring Company
    VDart, Inc.
  • Date
  • Deadline
  • Category

Jocancy Online Job Portal by jobSearchi.