cant read the whole excel file,if there 3 columns at first row,then read only 3 columns other all rows,that is a bug?or not

code

   `SparkConf conf = new SparkConf();
    SparkSession sparkSession = SparkSession.builder()        
    .appName(Test.class).config(conf).enableHiveSupport().getOrCreate();
    JavaSparkContext sc = new JavaSparkContext(sparkSession.sparkContext());
   Dataset<Row> load = new SQLContext(sc).read().format("com.crealytics.spark.excel")
                    .option("useHeader", "false")
                    .option("location","hdfs://rousit/user/shf/50550000000005.xls")
                    .option("inferSchema","false")
                    .option("addColorColumns", "false")
                    .option("treatEmptyValuesAsNulls", "false")
                    .load();
        JavaRDD<Row> rowJavaRDD = load.toJavaRDD();
             rowJavaRDD.foreachPartition(new VoidFunction<Iterator<Row>>() {
            @Override
            public void call(Iterator<Row> rowIterator) throws Exception {
                while (rowIterator.hasNext()){
                    Row row = rowIterator.next();
                    System.out.println(">>>>>>>row"+row);
                }
            }
        });

`

Your Environment

Include as many relevant details about the environment you experienced the bug in

• Spark version and language spark-version：2.11 java/jdk1.7
• Spark-Excel version:0.8.3 <dependency> <groupId>com.crealytics</groupId> <artifactId>spark-excel_2.11</artifactId> <version>0.8.3</version> </dependency>
• Operating System and version, cluster environment, …:

[quanghgx]

Back to the original query, from the title:

cant read the whole excel file,if there 3 columns at first row,then read only 3 columns other all rows,that is a bug?or not

Spark-excel should be able to read only 3 columns for all remaining rows.

• If the header have only 3 columns, it should work out of the box
• If the header have more then 3 needed columns, or does not have header at all, spark-excel can accept custom schema (with 3 columns), and this also work

Hi @zochunphy and @wenyangchou, I am going to close this ticket, feel free to reopen it.

[zochunphy]

spark-excel 0.10.2 only support xlsx file? xls file is not supported? https://github.com/crealytics/spark-excel/issues/62#issue-313632113