Hi,
We are having issues in the Spark UI notably when using Flintrock.
To have more context on our use of Flintrock:
- Flintrock version: 2.0.0
- Python version: 3.8.9
- OS: ubuntu:20.04
- We are using Flintrock in a private VPC with the option
authorize-access-from in the config file.
- We download Spark and Hdfs sources from our own S3 bucket.
When we go to the Spark UI on port 8080, the page is displayed correctly but the links to the other pages are broken.
Here you can find an extract from the HTML code of the page for a link to a worker.
<a href="http://<?xml version="1.0" encoding="iso-8859-1"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<title>404 - Not Found</title>
</head>
<body>
<h1>404 - Not Found</h1>
</body>
</html>:8081">
worker-20211015082848-<MASKED_IP>-42451
</a>
I have a similar error message when I launch spark-shell for example:
Spark context Web UI available at http://<?xml version="1.0" encoding="iso-8859-1"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<title>404 - Not Found</title>
</head>
<body>
<h1>404 - Not Found</h1>
</body>
</html>:4040
I have the impression that the error comes from a problem finding the ip address or something related.. maybe we have done a mistake with our configuration or maybe it's not related to Flintrock..
So, if you have any clues or elements to solve this problem, this would be a great help for us.
Thank you in advance for your help,
Maxime
Hi,
We are having issues in the Spark UI notably when using Flintrock.
To have more context on our use of Flintrock:
authorize-access-fromin the config file.When we go to the Spark UI on port 8080, the page is displayed correctly but the links to the other pages are broken.
Here you can find an extract from the HTML code of the page for a link to a worker.
I have a similar error message when I launch
spark-shellfor example:I have the impression that the error comes from a problem finding the ip address or something related.. maybe we have done a mistake with our configuration or maybe it's not related to Flintrock..
So, if you have any clues or elements to solve this problem, this would be a great help for us.
Thank you in advance for your help,
Maxime