Docsity
Docsity

Prepare-se para as provas
Prepare-se para as provas

Estude fácil! Tem muito documento disponível na Docsity


Ganhe pontos para baixar
Ganhe pontos para baixar

Ganhe pontos ajudando outros esrudantes ou compre um plano Premium


Guias e Dicas
Guias e Dicas


Instalando Hadoop-2.6.x em Windows 10, Esquemas de Programação de Rede

Este documento fornece instruções passo a passo para instalar o hadoop-2.6.x em um sistema operacional windows 10. O processo inclui a instalação de java 8, eclipse mars, o plugin hadoop para eclipse, apache-ant-1.9.6 e a própria distribuição do hadoop. Além disso, o documento detalha as configurações necessárias em vários arquivos de configuração, como core-site.xml, hdfs-site.xml, mapred.xml e yarn-site.xml.

Tipologia: Esquemas

2020

Compartilhado em 01/12/2020

ricardo-souza-82
ricardo-souza-82 🇧🇷

2 documentos

1 / 8

Toggle sidebar

Esta página não é visível na pré-visualização

Não perca as partes importantes!

bg1
Installing Hadoop-2.6.x on Windows 10.
Shantanu Sharma
Department of Computer Science, Ben-Gurion University, Israel.
1. Install Java 8: Download Java 8 from the link:
http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
a. Set environmental variables:
i. User variable:
Variable: JAVA_HOME
Value: C:\java
ii. System variable:
Variable: PATH
Value: C:\java\bin
b. Check on cmd, see below:
2. Install Eclipse Mars. Download it from the link: https://eclipse.org/downloads/ and extract it into C
drive.
a. Set environmental variables:
i. User variable:
Variable: ECLIPSE_HOME
Value: C:\eclipse
ii. System variable:
Variable: PATH
Value: C:\eclipse \bin
b. Download “hadoop2x-eclipse-plugin-master.” You will see three Jar files on the path
“hadoop2x-eclipse-plugin-master\release.” Copy these three jar files and pate them into
“C:\eclipse\dropins.
c. Download “slf4j-1.7.21.” Copy Jar files from this folder and paste them to “C:\eclipse\plugins”.
This step may create errors; when you will execute Eclipse, you will see errors like
org.apa…..jar file in multiple places. So, now delete these files from all the places except one.
Errors
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/C:/eclipse/plugins/org.slf4j.impl.log4j12_1.7.2.v20131105-
2200.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/C:/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-
1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
pf3
pf4
pf5
pf8

Pré-visualização parcial do texto

Baixe Instalando Hadoop-2.6.x em Windows 10 e outras Esquemas em PDF para Programação de Rede, somente na Docsity!

Installing Hadoop-2.6.x on Windows 10.

Shantanu Sharma

Department of Computer Science, Ben-Gurion University, Israel.

[email protected]

1. Install Java 8: Download Java 8 from the link:

http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html a. Set environmental variables: i. User variable:  Variable: JAVA_HOME  Value: C:\java ii. System variable:  Variable: PATH  Value: C:\java\bin b. Check on cmd, see below:

2. Install Eclipse Mars. Download it from the link: https://eclipse.org/downloads/ and extract it into C

drive. a. Set environmental variables: i. User variable:  Variable: ECLIPSE_HOME  Value: C:\eclipse ii. System variable:  Variable: PATH  Value: C:\eclipse \bin b. Download “hadoop2x-eclipse-plugin-master.” You will see three Jar files on the path “hadoop2x-eclipse-plugin-master\release.” Copy these three jar files and pate them into “C:\eclipse\dropins.” c. Download “slf4j-1.7.21. ” Copy Jar files from this folder and paste them to “C:\eclipse\plugins”. This step may create errors; when you will execute Eclipse, you will see errors like org.apa…..jar file in multiple places. So, now delete these files from all the places except one. Errors SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/C:/eclipse/plugins/org.slf4j.impl.log4j12_1.7.2.v20131105- 2200.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/C:/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12- 1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

3. Download Apache-ant-1.9.6 : (optional step) Download Apache-ant from the link: http://ant.apache.org/bindownload.cgi and extract it into a folder in C drive. 4. Download Hadoop-2.6.x : download Hadoop 2.6.x from the link: http://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-2.6.2/hadoop-2.6.2.tar.gz a. Put extracted Hadoop-2.6.x files into D drive. Note that do not put these extracted files into C drive, where you installed your Windows. b. Download “ hadoop-common-2.6.0-bin-master ” from the link: https://github.com/amihalik/hadoop-common-2.6.0-bin/tree/master/bin. You will see 11 files there. Paste all these files into the “bin” folder of Hadoop-2.6.x. c. Create a “data” folder inside Hadoop-2.6.x, and also create two more folders in the “data” folder as “data” and “name.” d. Create a folder to store temporary data during execution of a project, such as “D:\hadoop\temp.” e. Create a log folder, such as “D:\hadoop\userlog” f. Go to Hadoop-2.6.x etc  Hadoop and edit four files: i. core-site.xml ii. hdfs-site.xml iii. mapred.xml iv. yarn.xml core-site.xml

hadoop.tmp.dir D:\hadoop\temp

fs.default.name hdfs://localhost:50071

/hadoop-2.6.0/share/hadoop/mapreduce/, /hadoop-2.6.0/share/hadoop/mapreduce/lib/, /hadoop-2.6.0/share/hadoop/common/, /hadoop-2.6.0/share/hadoop/common/lib/, /hadoop-2.6.0/share/hadoop/yarn/, /hadoop-2.6.0/share/hadoop/yarn/lib/, /hadoop-2.6.0/share/hadoop/hdfs/, /hadoop-2.6.0/share/hadoop/hdfs/lib/,

yarn-site.xml