Codevian Technologies Pvt. Ltd.

Hadoop reporting platform (freelancer / consultant)

Pune, India

codevian Technology logo

Job Description

  • Install, configure and maintain enterprise hadoop environment.
  • Loading data from different datasets and deciding on which file format is efficient for a task. Hadoop developers source large volumes of data from diverse data platforms into Hadoop platform.
  • Understanding the requirements of input to output transformations.
  • Hadoop developers spend lot of time in cleaning data as per business requirements using streaming API’s or user defined functions.
  • Defining Hadoop Job Flows.
  • Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching impression streams, transaction behaviours, clickstream data and other unstructured data.
  • Managing Hadoop jobs using scheduler.
  • Reviewing and managing hadoop log files.
  • Design and implement column family schemas of Hive and HBase within HDFS.
  • Assign schemas and create Hive tables.
  • Managing and deploying HBase clusters.
  • Develop efficient pig and hive scripts with joins on datasets using various techniques.
  • Assess the quality of datasets for a hadoop data lake.
  • Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics.
  • Build new hadoop clusters
  • Maintain the privacy and security of hadoop clusters.
  • Fine tune hadoop applications for high performance and throughput.
  • Troubleshoot and debug any hadoop ecosystem run time issues.

Job Information

Work Experience

8 to 10yrs

Salary

Best in industry

Start Date

Immediate

Location

Remote

Qualification

Any

only accept .pdf, .doc, and .docx file

More Opportunities

We are looking for a skilled Network Engineer to design, implement, maintain, and support our growing network infrastructure. You will be part of a team...
25 July 2025
We are looking for a detail-oriented and results-driven Business Analyst with a strong background in supply chain and manufacturing processes. The ideal candidate will play...
25 July 2025
Baner, Pune (mandatory work from office).
We are looking for a skilled Salesforce Developer with hands-on experience in Lightning Web Components (LWC), Apex development, and API integrations (REST/SOAP). The ideal candidate...
23 July 2025
Accredited By

Got a Project Idea?
Talk to Our Experts!

Request a quote

customer

Thanks for contacting us

Our team will get back to you soon.