Big Data Platform Engineer
- Security, aerospace & defence
Are you ready to take the next step in your career?
Apply for this roleThis vacancy has now expired. Please see similar roles below...
Atkins has recently defined a “One Atkins 2020” Organisational strategy. To support this strategy, Atkins Group IS (GrIS) has defined an operating model for 2020 to revolutionise the way information services are provided to the organisation, moving from a BAU focus to a Business Value driven organisation. Key concepts include: moving to digital products, adopting agile across the organisation, leveraging cloud, and focusing on supporting bid and delivery.
Atkins Digital Services (ADS) operates within GrIS with a mission acquire, design, develop & deploy digital products that will add value to the business by enabling us to: win work at higher margins, deliver work more efficiently and at lower cost, develop new revenue streams, collaborate & share knowledge more effectively, manage our business and support our people. Supporting ADS is a global development team that delivers applications to both the business and clients.
Job Details
Atkins Digital Services (ADS) is looking to expand its capability by hiring Big Data Platform Engineer the new role will be part of a multi-disciplinary team that is responsible for new development, feature additions, maintenance and support of a number of key components of Big Data products and Platforms. The data platform will be cloud based, multitenanted and will support several analytical applications ranging from descriptive to predictive and cognitive.
The Big Data Platform Engineer will be responsible for management and administration of all Big data and distributed computing platforms in Atkins Global.
Working collaboratively with ADS colleagues and the wider Group IS team, you will bring creativity, technical knowledge and platform engineering experience that will support the development of new data products,
Key Deliverables/Responsibilities
• Ownership and accountability of the management and administration of the Big Data Platform.
• Manage and own the system upgrade and platform security on the Big data platform
• Plan, Manage and perform platform upgrades, connected ecosystem product upgrade as per roadmap; ensure alignment the new versions made available in open source and technology partner communities.
• Ownership and accountability of designing and implementing proactive capacity management
• Ownership of build, configuration, administration and management of Big data platforms and technologies.
• Ensures all components of the Big data service as a whole (and Hadoop with all ecosystem components in particular) is running normally and to SLA’s
• Troubleshoot cluster & ecosystem product issues as a priority with expertise & lead through to resolution working to SLA’s as defined within the Operational environment
• Troubleshoot network and infrastructure issues with expertise & lead through to resolution working to SLA’s as defined within the Operational environment
• Impact assessment of changes to the platform due to key projects.
• Define and build lightweight (low-overhead) monitoring system characteristics, in real time, and tools for correlating and analysing those statistics for the Big Data infrastructure to ensure good health of the infrastructure.
• Produce and manage advance workload characterization, benchmarks and metrics
• Instil a service mind-set and apply a strong focus on business continuity, Troubleshooting to ensure a good service
• First level go-to person for technical guidance, expertise support to consumer questions on operating services on the platform
• Serve as second level support to Big data operations for infrastructure and component services
• Work with engineering support on upgrades of the cluster participating in the installation, configuration and administration of multi-node Big data platforms
• Implementing new services to agreed SLA’s and ensuring transition to support or standardise services to Global services
•
Experience Required
Essential
• 3-4 years of experience building and managing complex end to end products/solutions with a strong background in IT infrastructure(Cloud Native), large scale enterprise business systems & distributed systems
• Experience developing solutions in cloud (Azure/AWS).
• 3+ years expert hands on experience working with Linux/Unix environment
• 1 year experience in Containerisation technologies like Docker, kubernetes.
• 1-2 yrs experience in managing Hadoop or any other distributed computing platforms/clusters with hundreds of servers
• Experience with running components in Hadoop eco system (Hive, Pig, Ambari, Oozie, Sqoop, Zookeeper, Mahout, Hadoop HDFS, YARN and MapReduce framework internals) and experience of hands on Java or Python.
• Experience building and managing NoSQL Database like HBase.
• Experience with managing security models for Big data platforms (Kerberos, Knox etc.)
• Demonstrable experience in working in a cloud environment
• Have in-depth knowledge of and hands on experience with a majority of the following:
- Distributed File Systems, cluster and parallel computer architectures
- Hadoop distributions (preferably Hortonworks), Map Reduce & Yarn
- Databases (MS SQL, MySQL etc)
- Server Operating systems internals, benchmarking and performance tuning (Linux)
- Multiple technologies including Java, C/C++, Unix Platforms and large scale implementations of programming theories/concepts with proven results.
• Ability to work occasional weekends and varied schedule (e.g. during go-live).
Desirable
· Contribution to industry/open source communities.
· Experience of working within a multi-cultural, global environment.
· Experience of working in a fast moving and changing large enterprise IT environment.
Are you ready to take the next step in your career?
Apply for this rolePreview
Middle EastContent type
BlogsPublish date
04/26/2024
Summary
By implementing reforms in the public sector and wider society, the KSA’s Vision 2030 has greatly improved government efficiency, bringing about new growth and investment opportunities. What is Visio
Preview
Middle EastContent type
BlogsPublish date
04/26/2024
Summary
By implementing reforms in the public sector and wider society, the KSA’s Vision 2030 has greatly improved government efficiency, bringing about new growth and investment opportunities. What is Visio
Related job roles
Salary
Location
Vasteras
Job Type
Full Time
Career Area
Integrity & legal
Category
Permanent
Location
Västerås
Description
JOINS US!Role: Head of Legal and Contract Management Location: Vasteras, SwedenJob OverviewLinxon is seeking an experienced Head of Legal and Contract Management to lead our legal and commercial team
Reference
R-114325
Expiry Date
01/01/0001
Salary
Location
Stockton-on-Tees
Job Type
Flexible Working
Full Time
Career Area
Project management
Market
Cities & development
Category
Permanent
Location
Stockton-on-Tees
Description
The AtkinsRéalis Infrastructure Project Delivery Practice (PDP) is the centre of excellence for the delivery of infrastructure projects and combines the best in project management and design managemen
Reference
R-114321
Expiry Date
01/01/0001
Author
Ritwi ChatterjeeAuthor
Ritwi ChatterjeeSalary
Location
Stockton-on-Tees
Job Type
Flexible Working
Full Time
Career Area
Project management
Market
Cities & development
Category
Permanent
Location
Stockton-on-Tees
Description
The AtkinsRéalis Infrastructure Project Delivery Practice (PDP) is the centre of excellence for the delivery of infrastructure projects and combines the best in project management and design managemen
Reference
R-114319
Expiry Date
01/01/0001
Author
Ritwi ChatterjeeAuthor
Ritwi ChatterjeeSalary
Location
Epsom
Job Type
Flexible Working
Full Time
Career Area
Natural sciences
Market
Cities & development
Category
Permanent
Location
Epsom
Description
To meet our growing project workload and help us design and apply new approaches to our work, we are looking for an experienced and enthusiastic Principal or Associate Ecologist to join our Epsom offi
Reference
R-114316
Expiry Date
01/01/0001
Author
Ritwi ChatterjeeAuthor
Ritwi ChatterjeeSalary
Location
London
Job Type
Full Time
Career Area
Architecture
Category
Permanent
Location
London
Description
Project Architect Role in the London StudioWe are AtkinsRealis: Architecture, Master planning, and Interior Design.We are a top 10 UK based global design Practice whose reputation is built on a cultur
Reference
R-114289
Expiry Date
01/01/0001
Author
Mahendran CVAuthor
Mahendran CVSalary
Location
Val D'Or
Job Type
Full Time
Career Area
Civil engineering
Market
Cities & development
Category
Permanent
Location
Amos
La Sarre
Rouyn-Noranda
Val D'Or
Description
Ingénieur(e) en génie civilAtkinsRéalis en Abitibi-Témiscamingue est en pleine croissance! Répartis dans plusieurs bureaux, nous offrons des services de génie-conseil et d’ingénierie d’usine principal
Reference
R-114285
Expiry Date
01/01/0001
Salary
Location
Bristol
Job Type
Full Time
Career Area
Health & safety
Category
Permanent
Location
West Midlands
Bristol
Exeter
Cardiff
Description
Location: Bristol/Birmingham/South West & South Wales OfficesJob DescriptionAtkinsRéalis is one of the world’s leading multi-disciplinary consultancy firms offering unparalleled opportunities for tale
Reference
R-114270
Expiry Date
01/01/0001
Author
Ritwi ChatterjeeAuthor
Ritwi ChatterjeeSalary
Location
Nashville
Job Type
Full Time
Career Area
Civil engineering
Market
Cities & development
Category
Permanent
Location
Nashville
Description
WE ARE HIRING!AtkinsRéalis is seeking an Aviation Engineer to join our East Aviation Team. This is an entry-level position and is based out of Nashville, TN. ABOUT US AtkinsRéalis is one of the world
Reference
R-114266
Expiry Date
01/01/0001
Salary
Location
Dubai
Job Type
Full Time
Career Area
Project controls
Market
Project, programme & cost management
Category
Permanent
Location
Dubai
Description
AtkinsRealis is currently looking for a Planner in Dubai, UAE to join a large programme of work.About AtkinsRéalis Created by the integration of long-standing organizations dating back to 1911, Atkins
Reference
R-114259
Expiry Date
01/01/0001
Salary
Location
Epsom
Job Type
Full Time
Career Area
Natural sciences
Market
Cities & development
Category
Permanent
Location
Epsom
Description
To meet our growing project workload and help us design and apply new approaches to our work, we are seeking an enthusiastic Assistant Ecologist to join our Epsom office and become a part of the Londo
Reference
R-114243
Expiry Date
01/01/0001
Author
Ritwi ChatterjeeAuthor
Ritwi ChatterjeeAtkinsRéalis
Talent community
Would you like to know more? Not ready to apply? Join our talent community to stay connected and engaged with us at AtkinsRéalis.
Find out more