johnomernik / maprdcos Goto Github PK
View Code? Open in Web Editor NEWRunning MapR on DCOS
License: Apache License 2.0
Running MapR on DCOS
License: Apache License 2.0
Not an issue, but an idea, I think we should mount up the cluster via NFS in the MapR Client build. Shouldn't be hard to do, but I think the "right" way to do it is to add the loopback or fuse client script to the image and run it, instead of hard coding in the image build script. Thoughts?
More of an idea than an issue, but it would be nice to be able to specify a license key and/or specify MapR credentials to have the cluster spin up licensed out of the box.
We should rewrite the memory calculations to occur within a docker container so bc and other tools don't need to be installed on the node you are doing the install from.
The build scripts obviously work for both the community and enterprise MapR versions, however it's easy for a community user to do things that the community edition doesn't support (multiple CLDBs, multiple NFS nodes, etc.). We should clearly document areas/decisions that are impacted and perhaps have a question that asks which version is being installed and change the questions accordingly.
Due to a currently being investigated bug, the MapR FUSE client doesn't work. However, if you wish to install the FUSE client, the Hadoop client will work on every node at this point. Just the fuse Filesystem will not work.
Alternative: start NFS on a node, and mount /mapr from all agents to that NFS server.
To increase compatibility, create docker containers to run the various scripts in this repo, including the scripts that build the containers (Docker in Docker). This is to help increase cross platform compatibility. The idea here is the ability to run this on any base OS running DC/OS.
The one challenge here will be the scripts that operate directly on the OS. I.e. the MapR packages for FUSE or NFS Loop back. Some OSes may not be able to run these on the host OS.
Alternatives would be to used licensed MapR and use the native NFS client.
Should create the /user/mapr directory in MapR-FS, otherwise certain features of the MapR Control System (when logged in as the MapR user) don't work, specifically MapR Tables.
Because the credentials used in the user prep script have to saved for use in the docker containers (or do they?) We store them in a directory in /home/zetaadm/creds We lock this directory down, but it's still scary to have credentials there.
Some points:
If you are running the posix client (FUSE) on a physical node, and the docker container (MapR Server) is running the NFS server. The Fuse Client will fail randomly. It provides little error, just umounts and has to be restarted.
Due to an issue with shared memory, the NFS Loopback doesn't work at this time. Currently working with MapR.
Alternatives: If using M3 (community) MapR, start NFS on a node, and have all individual nodes mount NFS there.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.