how to add many arguments in the yaml config of the mainApplicationFile · Issue #1613

link管理

链接快照平台

输入网页链接，自动生成快照
标签化管理网页链接

相关文章推荐

重感情的酸菜鱼 · Apache MXNet | 知否Box ...· 7 小时前 ·

长情的豆腐 · 什么是 Apache Ranger？| IBM· 7 小时前 ·

英姿勃勃的冲锋衣 · Apache MXNet - ...· 7 小时前 ·

酒量小的四季豆 · Apache MXNet | AI工具集· 7 小时前 ·

眉毛粗的书签 · JSTL依赖问题org.apache.jas ...· 17 小时前 ·

威武的马克杯 · 小米IPO概念股再盘点：八大生态链和供应链公 ...· 2 周前 ·

唠叨的火车 · MediaStore and ...· 1 月前 ·

任性的黑框眼镜 · DTCC 干货分享：Real Time ...· 1 月前 ·

逃跑的企鹅 · 杭州英特外国语学校高中语言特色班2022年招 ...· 3 月前 ·

讲道义的甘蔗 · 玄凤鹦鹉多久洗一次澡？怎么洗? - 知乎· 8 月前 ·

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement . We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I have the same issue

+ CMD=("$SPARK_HOME/bin/spark-submit" --conf "spark.driver.bindAddress=$SPARK_DRIVER_BIND_ADDRESS" --deploy-mode client "$@")
+ exec /usr/bin/tini -s -- /opt/spark/bin/spark-submit --conf spark.driver.bindAddress=192.168.139.112 --deploy-mode client --properties-file /opt/spark/conf/spark.properties --class com.payten.dar.Main local:///opt/spark-jars/DataAnalyticsReporting.jar '--kafka 10.99.39.20:9092' '--dburls k8ssandra-dc1-service.k8ssandra' '--dbport 9042' '--dbuser k8ssandra-superuser' '--dbpass 4LhL7b2IWwcLbEA0vCYV'
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/opt/spark/jars/spark-unsafe_2.12-3.1.1.jar) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
22/09/21 15:11:38 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in thread "main" java.lang.IllegalAccessError: class org.apache.commons.cli.DefaultParser tried to access method 'java.util.Collection org.apache.commons.cli.Options.getOptionGroups()' (org.apache.commons.cli.DefaultParser is in unnamed module of loader org.apache.spark.util.MutableURLClassLoader @3276732; org.apache.commons.cli.Options is in unnamed module of loader 'app')
        at org.apache.commons.cli.DefaultParser.parse(DefaultParser.java:704)
        at org.apache.commons.cli.DefaultParser.parse(DefaultParser.java:679)
        at org.apache.commons.cli.DefaultParser.parse(DefaultParser.java:660)
        at com.payten.dar.ConfigOptions.<init>(ConfigOptions.java:104)
        at com.payten.dar.Main.main(Main.java:24)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.base/java.lang.reflect.Method.invoke(Unknown Source)
        at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
        at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:951)
        at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
        at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
        at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
        at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1030)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1039)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
log4j:WARN No appenders could be found for logger (org.apache.spark.util.ShutdownHookManager).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.