зеркало из https://github.com/microsoft/spark.git
Use ec2-metadata in start-slave.sh.
PR #419 applied the same change, but only to start-master.sh, so some workers were still starting their web UI's using internal addresses. This should finally fix SPARK-613.
This commit is contained in:
Родитель
a2b0a7975c
Коммит
cda2b15041
|
@ -6,7 +6,8 @@ bin=`cd "$bin"; pwd`
|
|||
# Set SPARK_PUBLIC_DNS so slaves can be linked in master web UI
|
||||
if [ "$SPARK_PUBLIC_DNS" = "" ]; then
|
||||
# If we appear to be running on EC2, use the public address by default:
|
||||
if [[ `hostname` == *ec2.internal ]]; then
|
||||
# NOTE: ec2-metadata is installed on Amazon Linux AMI. Check based on that and hostname
|
||||
if command -v ec2-metadata > /dev/null || [[ `hostname` == *ec2.internal ]]; then
|
||||
export SPARK_PUBLIC_DNS=`wget -q -O - http://instance-data.ec2.internal/latest/meta-data/public-hostname`
|
||||
fi
|
||||
fi
|
||||
|
|
Загрузка…
Ссылка в новой задаче