ETL/Big Data Developer

ETL/Big Data Developer

Vacancy expired!

This is a Fulltime Direct Hire Role with a HealthCare Client
Please Note: This is a Fulltime direct hire position with an Energy Client and the client will only consider candidates who are able to work with the client on their w2 without any sponsorship now or in the futureIf you are on any kind of visa please do not apply to this role, unfortunately, candidates on a VISA will not be considered for this role

G-C and U-S-C only

Candidate must be Local to Houston TX
Job Title: Senior ETL Developer
Location: Houston, TX
Brief Description:
The Senior ETL Developer will be responsible for design, development and testing of software solutions using SQL, Java, HBase, Spark, Scala and Kudu/Impala. This role requires experience in building new data pipelines and data ingestion applications to bring large volumes of transactional and unstructured data into data lakes. The ideal candidate should have very good analytical skills, Hadoop and Java based application development. The ideal candidate should also possess good communication and interpersonal skills, attention to detail, a high level of motivation / work ethic and a proven track record in designing and developing big data applications.
This role performs under general direction of the Director, Drilling Optimization and Data Center.
Detailed Description:
• Design and development of Java and Hadoop based applications using object oriented design practices and standard frameworks such as MVC, MVVM.
• Develop API’s and data ingestion pipelines to process structured and unstructured data
• Develop migration strategies to move SQL databases to the big data platform and support business stakeholders with complex relational queries
• Ensure quality and timely response to business requests for data and reporting
• Monitor and validate real time data, identify drilling trends, irregularities or deviations and present findings, develop process improvements that improve data quality, drive efficiency, mitigate risk, or provide value to the organization
• Lead, mentor and train other developers on developing big data solutions
• Ability to interact with multiple levels within an organization.
Job Requirements:
• Hands-on development experience using open source and big technology stack – HBase, Scala, Spark, Kudu/Impala, Java, Hive and others to build complex data solutions. Experience working through the full product cycle from initial design to final product delivery
• Proficient in data lake architecture, data pipelining and ingestion practices, database design, data warehousing, complex querying and optimization
• Proven experience working with complex data structures and performance tuning activities
• Work closely with business teams, understand the drilling process/work flows and efficiently implement this in SQL or Scala programs.
• Proven ability in working with large, complex projects focused on end-to-end business flows through multiple systems
• Ability to work with 3rd party software and develop code/APIs to be embedded or integrated into other applications or frameworks
• Ability to build, package and deploy the applications using continuous integration, with automated unit tests
• Experience in working with WCF and REST based Web Services
• Strong communication and presentation skills and proven track record in supporting multiple business units and management at all levels
• Excellent verbal and written communication skills
Minimum Qualifications
• Bachelor’s Degree in Information Technology, Computer Science, Data Analytics, or related field
• SQL and NoSQL Databases – 5 years
• 3 years’ experience with Java/J2EE
• 3 years’ experience with Spark, Scala, Kudu/Impala, HBase
Preferred Qualifications
• One year experience with Hadoop/Hive/Pig/MapReduce
• Web development experience using responsive design with HTML5, AngularJS or Kendo frameworks
• Experience building Business Intelligence Analytics and Visualizations using Qlik Sense, Tableau, Spot Fire, Microsoft Power BI or other technology
• Experience in Oil & Gas / drilling industry
• Experience in AWS/Microsoft Azure and Cloud ready applications
Additional