I'm trying to list number of files in s3 bucket. I've initially used "aws s3 ls <s3://>" to list the files and it worked. However, when trying to do the same using dbutils.fs.ls , I'm getting

java.lang.NullPointerException: null uri host. This can be caused by unencoded / in the password string

My main goal is to export this list of output in either a txt or csv file and save in somewhere in DBFS. Would it be possible to do so just using bash? If not, how would you fix this error using dbutils.fs.ls? Thank you for your time

If there isn’t a group near you, start one and help create a community that brings people together. Request a New Group © Databricks 2024. All rights reserved. Apache, Apache Spark, Spark and the Spark logo are trademarks of the Apache Software Foundation.

Privacy Notice

| Terms of Use

| Your Privacy Choices

| Your California Privacy Rights