Comments (9)
I don't know since I haven't tested any newer Zeppelin versions yet. Outside Zeppelin, Spark 2.2 and ORC files seem to play nice.
from cloud-local.
@anitagraser if you change the Cloud-Local config file, is there a pair of versions that does currently work for you? So, the problem is just the defaults that we have in place?
from cloud-local.
I did not try changing the config files, but I installed Spark 2.0 and that works. (I had an issue using ORC files with Spark 2.1)
from cloud-local.
Spark 0.7 isn't available on the archive http://archive.apache.org/dist/spark/ so I'm going to attempt something like Spark 0.9.2
I also found a bug in cloud-local.sh where we are missing a slash in the Zepplin download URL. Clearly no one has been testing Zepplin recently. Frankly, I wasn't even sure how to test it beyond the standard download and install steps but I'll give it a try.
from cloud-local.
Also, I found the Zepplin 0.7.0 release notes and it is supposed to support Spark 2.1 so that should work fine through standard config changes. https://zeppelin.apache.org/releases/zeppelin-release-0.7.0.html
from cloud-local.
P/R #66 was tested with this config:
--- a/conf/cloud-local.conf
+++ b/conf/cloud-local.conf
@@ -37,7 +37,7 @@ pkg_zookeeper_ver="3.4.10"
pkg_kafka_scala_ver="2.11"
pkg_kafka_ver="0.9.0.1"
-pkg_spark_ver="2.2.0"
+pkg_spark_ver="2.1.2"
# Note pkg_hadoop_ver above
# - don't auto-derive this as spark & hadoop major releases aren't lock-step
# - use "without-hadoop" to use version without hadoop deps
@@ -110,5 +110,5 @@ fi
# Enable/Disable Zepplin
# You must change Spark to a compatible version (2.1.x)
-zeppelin_enabled=0
+zeppelin_enabled=1
from cloud-local.
Sorry, I mixed up the Spark and Zeppelin versions this morning. I fixed them in the above comment now. Basically, Spark 2.1 worked fine with Zeppelin except that I couldn't read ORC files.
from cloud-local.
Ok, the release notes are not written the same way between Zeppelin versions but I found that 0.7.3 supports Spark 2.2 https://issues.apache.org/jira/browse/ZEPPELIN-2768 so we could/should bump the default Spark and Zeppelin versions in the config.
Will the newest Spark + Zeppelin read your files?
from cloud-local.
P/R merged, I'm going to assume this will work for you now. Please open a new issue as needed. Thanks for your interest in the project!
from cloud-local.
Related Issues (20)
- Make ports configurable HOT 3
- cloud-local.sh init fails HOT 3
- Add status command to cloud local HOT 5
- errors in config.sh crash terminal HOT 2
- Provide unset command HOT 1
- Add Spark (but not the service) HOT 3
- Change Spark to "without hadoop" download? HOT 5
- Check Hbase ports HOT 1
- GeoMesa downloads attempted even when disabled HOT 2
- Failure from GEOSERVER_HOME not set HOT 1
- Add better package cacheing HOT 2
- check_port function uses incorrect variable HOT 1
- verify_stop doesn't filter by current user HOT 1
- Hadoop download not working HOT 4
- Use Apache archive site to allow for old versions of software HOT 1
- In ports.sh don't try to edit files that don't exist
- Update to Accumulo 1.9.2
- Malware injection kinsing
- Issue when starting hbase: JAVA_HOME not set HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cloud-local.