- Ejecutar el comando adentro de la carpeta
mvn clean package
- Situarse en el directorio
target
y enviarlo a Pampero:scp graphframes-tpe-1.jar [email protected]:./
- En Pampero enviar el *jar al node1
scp graphframes-tpe-1.jar [email protected]:./
(accedan a mi cuenta. Password es igual que el username) - Situarse dentro de node1 (con ssh a mi usuario).
spark-submit --master yarn --deploy-mode=cluster --class ar.edu.itba.nosql.GraphFramesAppMain --jars hdfs:///user/kcortesrodrigue/graphframes-0.6.0.jar ./graphframes-tpe-1.jar <NUMERO_QUERY> <PATH_ABSOLUTO_CATEGORY> <PATH_ABSOLUTO_CATEGORIES> <PATH_ABSOLUTO_VENUES> <PATH_ABSOLUTO_STOPS>
. Para realizar esto mismo, deben estar todos los archivos en todos los nodos. - (Paso si está fuera del ITBA) En una terminal, hacer un proxy socks que escuche en localhost:9090
ssh -D 9090 [email protected]
- (Paso si está fuera del ITBA) Entrar a
chrome://settings
y buscar la configuración del proxy. Settearlo con los valores puestos en el item anterior. - En
node1.it.itba.edu.ar:8080
ingresar con usuario/contraseña, y hacer Spark2 >> Spark2 History Server UI >> clic en AppID recien ejecutado >> Executors >> Clic en primer stdout del lado de la derecha (donde dice driver)
nosql-graphframes's Introduction
nosql-graphframes's People
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.