Codevian Technologies Pvt. Ltd.

Hadoop reporting platform (freelancer / consultant)

Pune, India

codevian Technology logo

Job Description

  • Install, configure and maintain enterprise hadoop environment.
  • Loading data from different datasets and deciding on which file format is efficient for a task. Hadoop developers source large volumes of data from diverse data platforms into Hadoop platform.
  • Understanding the requirements of input to output transformations.
  • Hadoop developers spend lot of time in cleaning data as per business requirements using streaming API’s or user defined functions.
  • Defining Hadoop Job Flows.
  • Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching impression streams, transaction behaviours, clickstream data and other unstructured data.
  • Managing Hadoop jobs using scheduler.
  • Reviewing and managing hadoop log files.
  • Design and implement column family schemas of Hive and HBase within HDFS.
  • Assign schemas and create Hive tables.
  • Managing and deploying HBase clusters.
  • Develop efficient pig and hive scripts with joins on datasets using various techniques.
  • Assess the quality of datasets for a hadoop data lake.
  • Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics.
  • Build new hadoop clusters
  • Maintain the privacy and security of hadoop clusters.
  • Fine tune hadoop applications for high performance and throughput.
  • Troubleshoot and debug any hadoop ecosystem run time issues.

Job Information

Work Experience

8 to 10yrs

Salary

Best in industry

Start Date

Immediate

Location

Remote

Qualification

Any

only accept .pdf, .doc, and .docx file

More Opportunities

Technical Strapi specialist
Bangalore/Hyderabad/Chennai/Mumbai/Pune/Gurgaon/Panchkula (Work From Office)
Looking for a technical Strapi specialist who can handle content entry as well as schema validation, content modeling, API interactions, and workflow optimization....
11 December 2025
IT Recruiter – Fresher
Pune – Baner (Onsite)
We are looking for a proactive and detail-oriented IT Recruiter (Fresher) to join our Talent Acquisition team. The ideal candidate should have strong communication skills...
09 December 2025
We are looking for a skilled QA Automation Engineer with strong expertise in Python, Selenium WebDriver, and automation frameworks. The ideal candidate will have hands-on...
09 December 2025
Accredited By

Got a Project Idea?
Talk to Our Experts!

Request a quote

customer

Thanks for contacting us

Our team will get back to you soon.