Mini YARN/DFS cluster

小型 YARN/DFS 集群,用于开发和测试基于 YARN 的应用程序(如 Tez)。「Mini YARN/DFS cluster for developing and testing YARN-based applications (e.g., Tez)」

  • Owner: hortonworks/mini-dev-cluster
  • Platform:
  • License:: Apache License 2.0
  • Category::
  • Topic:
  • Like:
    0
      Compare:

Github stars Tracking Chart

Mini YARN/DFS cluster for developing and testing YARN-based applications (e.g., Tez)

================

Configure the development environment.

Clone the project first.

git clone https://github.com/hortonworks/mini-dev-cluster.git

Once cloned, navigate to the project's root cd mini-dev-cluster and follow these instructions. You should be up and running in less then a min.

This project uses Gradle as its build and dependency management (see http://www.gradle.org/). Gradle is self-provisioning build framework which means you don't have to have Gradle installed to follow the rest of the procedure.

BUILD for development:

Depending on the IDE you are using execute the following gradle script.

Eclipse:
./gradlew clean eclipse
IntelliJ IDEA
./gradlew clean idea

The above will generate all necessary IDE-specific artifacts to successfully import the project.
Import the project into your IDE.
For example in Eclipse follow this procedure:

File -> Import -> General -> Existing Project Into Workspace -> browse to the root of the project and click Finish

NOTE: You don't have to import projects as Gradle and/or Maven project. The ./gradlew clean eclipse/idea command will take care of generating all the necessary IDE-native artifacts so you can import it as Eclipse/Gradle project and not deal with wrong plugin versions of one or another.

==

START MINI CLUSTER

IDE:
Simply execute com.hortonworks.minicluster.StartMiniHadoopCluster
Command line
shell> ./gradlew clean installApp 
shell> build/install/mini-dev-cluster/bin/mini-dev-cluster

==

Core Features

This is an evolving work in progress so more updates (code and documentation) will be coming soon

Main metrics

Overview
Name With Ownerhortonworks/mini-dev-cluster
Primary LanguageJava
Program languageGroovy (Language Count: 4)
Platform
License:Apache License 2.0
所有者活动
Created At2012-11-19 20:14:46
Pushed At2023-10-17 13:04:47
Last Commit At2023-05-20 01:27:01
Release Count151
Last Release Namev1.5.18 (Posted on )
First Release Namehystrix-1.0.0 (Posted on 2012-11-21 23:25:37)
用户参与
Stargazers Count23.8k
Watchers Count1.7k
Fork Count4.8k
Commits Count2.1k
Has Issues Enabled
Issues Count1029
Issue Open Count347
Pull Requests Count677
Pull Requests Open Count53
Pull Requests Close Count82
项目设置
Has Wiki Enabled
Is Archived
Is Fork
Is Locked
Is Mirror
Is Private