Big Data Engineer

Big Data Engineer

03 Jun 2024
South Carolina, Columbia, 29201 Columbia USA

Big Data Engineer

Description We are offering a contract to hire employment opportunity for a Big Data Engineer based in Columbia, Maryland. This role involves working within a complex data environment, focusing on data parallelization and clustering, Spark coding, and BI data warehousing. The successful candidate will be expected to handle a variety of tasks related to data engineering, database management, and business intelligence.Responsibilities: Develop and maintain Databricks for financial ledgers, handling data parallelization and data clustering tasks Utilize Spark coding to enhance data processing and analysis capabilities Work on BI data warehousing projects to support business intelligence initiatives Handle data extraction from various sources, including Oracle BI connector console and Azure data factory Manage data staging and preparation in line with MS conventions, ensuring the correct use of silver, bronze, gold data tiers within Databricks Develop and maintain architecture based on data stages and surface insights via Power BI single semantic layer of control Understand and work with financial data and ledgers, ensuring familiarity with accounting and finance terminologies Diagnose and resolve data-related problems, with a particular focus on data extraction from Oracle Understand data modeling and ensure its correct application in various projects Train and support junior developers to ensure consistent and accurate data extraction from Oracle Utilize skills in Apache Cassandra, Apache Kafka, Apache Pig, Apache Spark, Database, AB Testing, Apache Hadoop, API Development, AWS Technologies, Big Data, Azure Databricks, Databricks, Spark SQL, Business Intelligence (BI), Business Intelligence and Data Warehousing (BI DW), Azure DevOps, Azure SQL Database, Oracle, and others as necessary. Requirements Proficiency in Big Data tools such as Apache Cassandra, Apache Kafka, Apache Pig, Apache Spark, and Apache Hadoop is mandatory. Expertise in Database technologies and the ability to perform AB Testing is essential. Proficiency in API Development and AWS Technologies is required. Proven experience with Azure Databricks, Databricks, and Spark SQL is necessary. Familiarity with Business Intelligence (BI) and Business Intelligence and Data Warehousing (BI DW) is a plus. Experience in Azure DevOps and Azure SQL Database is desirable. Knowledge of Oracle technologies is beneficial. Prior experience working as a Big Data Engineer is crucial. Strong analytical skills and problem-solving ability. Excellent communication and collaboration skills. Bachelor's degree in Computer Science, Information Technology, or a related field is required. Relevant certifications in Big Data or related fields will be considered a plus. Ability to work in a fast-paced, dynamic environment. Strong commitment to professional growth and continuous learning. High level of adaptability and flexibility. Technology Doesn't Change the World, People Do.® Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.© 2024 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https:///www.roberthalf.com/us/en/terms) .

Related jobs

Job Details

Jocancy Online Job Portal by jobSearchi.