Codevian Technologies Pvt. Ltd.

Hadoop reporting platform (freelancer / consultant)

Pune, India

Job Description

  • Install, configure and maintain enterprise hadoop environment.
  • Loading data from different datasets and deciding on which file format is efficient for a task. Hadoop developers source large volumes of data from diverse data platforms into Hadoop platform.
  • Understanding the requirements of input to output transformations.
  • Hadoop developers spend lot of time in cleaning data as per business requirements using streaming API’s or user defined functions.
  • Defining Hadoop Job Flows.
  • Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching impression streams, transaction behaviours, clickstream data and other unstructured data.
  • Managing Hadoop jobs using scheduler.
  • Reviewing and managing hadoop log files.
  • Design and implement column family schemas of Hive and HBase within HDFS.
  • Assign schemas and create Hive tables.
  • Managing and deploying HBase clusters.
  • Develop efficient pig and hive scripts with joins on datasets using various techniques.
  • Assess the quality of datasets for a hadoop data lake.
  • Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics.
  • Build new hadoop clusters
  • Maintain the privacy and security of hadoop clusters.
  • Fine tune hadoop applications for high performance and throughput.
  • Troubleshoot and debug any hadoop ecosystem run time issues.

Job Information

Work Experience

8 to 10yrs

Salary

Best in industry

Start Date

Immediate

Location

Remote

Qualification

Any

only accept .pdf, .doc, and .docx file

More Opportunities

We are seeking a skilled and experienced Java Developer to join our team. The ideal candidate will have a strong background in Java development, with...
05 May 2025
If anyone from Pune, good experience we may consider however resource needs to be at nasik for 1-2months initially for project kt
We are seeking a skilled DevOps Engineer with 1-3 years of experience to join our dynamic team. The ideal candidate will have hands-on experience in...
05 May 2025
A Salesforce Commerce Cloud developer builds and maintains online stores and e-commerce functionalities using Salesforce's Commerce Cloud platform. This role involves designing, coding, testing, and...
28 April 2025
Accredited By

Got a Project Idea?
Talk to Our Experts!

Request a quote

customer

Thanks for contacting us

Our team will get back to you soon.