Hello :) I am new to lakeFS and finding a way to integrate with Hadoop cluster I’ve found several similar questions and the answer was “no” back then. I’m wondering if there are still no support for HDFS and if not, are there are any workarounds or examples for using HDFS as an underlying storage?

Hi @성진영, As of now, lakeFS does not offer native support for HDFS. The core architecture of lakeFS is designed to work with object storage systems that provide strong consistency, such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.

@Barak Amar thank you

Please note that there could be solutions available that address these challenges in HDFS. If such solutions exist, using an S3 adapter on top of them would likely be effective. However, I am not aware of any specific cases, maybe someone from the community will have more information.