Spark2.3整合bubbo问题总结

1.在java代码中写scala代码

image.png

编译后会出现scala代码找不到，需要在pom.xml添加

              
                net.alchim31.maven
                scala-maven-plugin
                3.2.0
                
                    
                        scala-compile-first
                        process-resources
                        
                            add-source
                            compile
                        
                    
                    
                        test-compile-scala
                        test-compile
                        
                            add-source
                            testCompile
                        
                    
                
                
                    ${scala.binary.version}
                
            

2.为了减少定位问题成本，使用jdk1.8，不然会出现各种诡异问题

image.png

3.dubbo中使用jdk

image.png

init.sh中添加

shopt -s expand_aliases
export JAVA_HOME="/usr/local/jdk18"
alias java="/usr/local/jdk18/bin/java"
alias nohup=":;"

wiki：

4.jar包冲突

使用mvn dependency:tree排除低版本jar包

image.png

5.spark启动异常

Exception in thread "main" java.net.BindException: Cannot assign requested address: bind: Service 'sparkDriver' failed after 16 retries (on a random free port)! 
Consider explicitly setting the appropriate binding address for the service 'sparkDriver' (for example spark.driver.bindAddress for SparkDriver) to the correct binding address.

添加SPARK_LOCAL_IP变量，整合dubbo在init.sh中添加export SPARK_LOCAL_IP="127.0.0.1"

image.png