Big Data Engineer

Big Data Engineer

16 Nov 2024
Massachusetts, Boston 00000 Boston USA

Big Data Engineer

Vacancy expired!

IntroductionIs data your jam? Do you think BIG Data is better data? Do you think data lakes are more fun than real lakes? Do you enjoy solving business problems with data and communicating your recommendations to others? Do you get excited about learning new tools in the Hadoop ecosystem? Do you like to travel? Are you self-motivated and like working on teams? This role might be for you!IBM is seeking Big Data Developer with technical experience in optimizing of management and deriving insights from large, non-structured, non-relational data.Your Role and Responsibilities

Design, develop, and implement batch and real time data integrationusing Big Data technologies such as Hadoop, HDFS, Hive, Spark, Flink, Sqoop, Apache Nifi, Streamsets, Impala, Kafka, NoSQL (HBase/Cassandra/MongoDB)

Design and develop code using one or more programming languages such as Python, Java, Shell Scripts, Scala

Perform component and integration testing of the code assets

Support code build and deploy using tools such as Maven, Gradle, SBT, GitBucket, SVN

Use JIRA, Confluence to collaborate, track and document development activities

Participate in all aspects of the software life cycle, including analysis, design, development, unit testing, production deployment and support.

Formulate approaches and gather data to solve technical problems, develop conclusions and present solutions through formal deliverables.

Create Big Data accelerators to help deploy scalable solutions fast

You will be successful in this role if you enjoy problem solving and utilizing consulting skills. Team leadership experience is preferred.In this dynamic role, you will have the opportunity to interact directly with clients. As such, travel to client sites may be required, up to 4 days per week. Preferred candidates will reside within a 50 mile radius of a major airport.CPT18Required Technical and Professional Expertise

Minimum 5 years of programming experience in core Java, Python and Unix scripting

Minimum 2 year of experience in Apache Kafka

Minimum 2 year of experience in Hadoop, HDFS, Sqoop and Hive

Minimum 2 year of experience in HBase or Cassandra or MongoDB

Minimum 2 year of experience in programming using Spark and Spark Streaming

Minimum 2 years of working experience on Agile & Scrum methods

Preferred Technical and Professional Expertise

Exposure to Application and Data integration using REST or Thrift or JMS

Exposure to search/index technologies such as ElasticSearch or Solr

Experience on continuous build and integration using tools such as Gradle and Jenkins

Experience in performance monitoring tools such as DynaTrace and Splunk

Experience in REST API and JMS and WebServices and MQ

Experience in JUnit and JMeter and MRUnit or other testing tools

Knowledge of Docker and MicroServices

Knowledge of Domain driven design

About Business UnitIBM Services is a team of business, strategy and technology consultants that design, build, and run foundational systems and services that is the backbone of the world's economy. IBM Services partners with the world's leading companies in over 170 countries to build smarter businesses by reimagining and reinventing through technology, with its outcome-focused methodologies, industry-leading portfolio and world class research and operations expertise leading to results-driven innovation and enduring excellence.Your Life @ IBMWhat matters to you when you’re looking for your next career challenge?Maybe you want to get involved in work that really changes the world? What about somewhere with incredible and diverse career and development opportunities – where you can truly discover your passion? Are you looking for a culture of openness, collaboration and trust – where everyone has a voice? What about all of these? If so, then IBM could be your next career challenge. Join us, not to do something better, but to attempt things you never thought possible.Impact. Inclusion. Infinite Experiences. Do your best work ever.About IBMIBM’s greatest invention is the IBMer. We believe that progress is made through progressive thinking, progressive leadership, progressive policy and progressive action. IBMers believe that the application of intelligence, reason and science can improve business, society and the human condition. Restlessly reinventing since 1911, we are the largest technology and consulting employer in the world, with more than 380,000 IBMers serving clients in 170 countries.Location StatementFor additional information about location requirements, please discuss with the recruiter following submission of your application.Being You @ IBMIBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Related jobs

Job Details

Jocancy Online Job Portal by jobSearchi.