github
/
k3s
mirror of https://github.com/k3s-io/k3s
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
k3s/examples/spark/spark-master-service.yaml

15 lines
230 B
YAML
Raw Normal View History

Spark: Update to current example standards, add GCS connector * Pod -> ReplicationController, which also forced me to hack around hostname issue on the master. (Spark master sees the incoming slave request to spark-master and assumes it's not meant for it, since it's name is spark-master-controller-abcdef.) * Remove service env dependencies (depend on DNS instead). * JSON -> YAML. * Add GCS connector. * Make example do something actually useful: A familiar example to anyone at Google, implement wordcount of all of Shakespeare's works. * Fix a minor service connection issue in the gluster example.
2015-10-26 20:42:02 +00:00
kind: Service
apiVersion: v1
metadata:
name: spark-master
spec:
ports:
- port: 7077
targetPort: 7077
Updating Spark Example. Few usability improvements: - Added a proxy to enable viewing worker logs - Removed seperate webui service - Modified Zeppelin and spark-ui services to be Loadbalancers - Changed pyspark example to be platform agnostic - Improved kubectl context setup - Minor grammar/flow fixes
2016-09-27 19:01:34 +00:00
name: spark
- port: 8080
targetPort: 8080
name: http
Spark: Update to current example standards, add GCS connector * Pod -> ReplicationController, which also forced me to hack around hostname issue on the master. (Spark master sees the incoming slave request to spark-master and assumes it's not meant for it, since it's name is spark-master-controller-abcdef.) * Remove service env dependencies (depend on DNS instead). * JSON -> YAML. * Add GCS connector. * Make example do something actually useful: A familiar example to anyone at Google, implement wordcount of all of Shakespeare's works. * Fix a minor service connection issue in the gluster example.
2015-10-26 20:42:02 +00:00
selector:
component: spark-master