Robin Moffatt
05/31/2023, 12:10 PMFailed to get lakeFS blockstore type
. Details in notebook - could someone point where I'm going wrong please? I'm using Everything Bagel with MinIO for storage
https://gist.github.com/rmoff/c3d6553aec11b569d8f1e1761b7182e5Niro
05/31/2023, 1:28 PMRobin Moffatt
05/31/2023, 1:29 PMNiro
05/31/2023, 1:29 PMRobin Moffatt
05/31/2023, 1:30 PMAdmins
groupNiro
05/31/2023, 1:40 PMRobin Moffatt
05/31/2023, 2:13 PMNiro
05/31/2023, 3:31 PMRobin Moffatt
05/31/2023, 4:01 PMINFO
. Even with it set to DEBUG
I don't see anything from lakeFS, just the notebook
jupyter-notebook | 23/05/31 16:01:03 WARN FileSystem: Failed to initialize fileystem <lakefs://test/main/users>: java.io.IOException: Failed to get lakeFS blockstore type
jupyter-notebook | 23/05/31 16:05:39 DEBUG FileSystem: Starting: Acquiring creator semaphore for <lakefs://test/main/users>
jupyter-notebook | 23/05/31 16:05:39 DEBUG FileSystem: Acquiring creator semaphore for <lakefs://test/main/users>: duration 0:00.001s
jupyter-notebook | 23/05/31 16:05:39 DEBUG FileSystem: Starting: Creating FS <lakefs://test/main/users>
jupyter-notebook | 23/05/31 16:05:39 DEBUG FileSystem: Looking for FS supporting lakefs
jupyter-notebook | 23/05/31 16:05:39 DEBUG FileSystem: looking for configuration option fs.lakefs.impl
jupyter-notebook | 23/05/31 16:05:39 DEBUG FileSystem: Filesystem lakefs defined in configuration option
jupyter-notebook | 23/05/31 16:05:39 DEBUG FileSystem: FS for lakefs is class io.lakefs.LakeFSFileSystem
jupyter-notebook | 23/05/31 16:05:39 DEBUG FsUrlStreamHandlerFactory: Creating handler for protocol http
jupyter-notebook | 23/05/31 16:05:39 DEBUG FsUrlStreamHandlerFactory: Unknown protocol http, delegating to default implementation
jupyter-notebook | 23/05/31 16:05:39 WARN FileSystem: Failed to initialize fileystem <lakefs://test/main/users>: java.io.IOException: Failed to get lakeFS blockstore type
jupyter-notebook | 23/05/31 16:05:39 DEBUG FileSystem: Failed to initialize fileystem
jupyter-notebook | java.io.IOException: Failed to get lakeFS blockstore type
Niro
05/31/2023, 4:07 PMjupyter-notebook | 23/05/31 16:05:39 DEBUG FsUrlStreamHandlerFactory: Creating handler for protocol http
jupyter-notebook | 23/05/31 16:05:39 DEBUG FsUrlStreamHandlerFactory: Unknown protocol http, delegating to default implementation
This looks suspiciousRobin Moffatt
05/31/2023, 4:08 PMNiro
05/31/2023, 4:08 PMRobin Moffatt
05/31/2023, 4:10 PMNiro
05/31/2023, 4:11 PMRobin Moffatt
05/31/2023, 4:12 PMroot@be6ae10d9902:/# curl <http://lakefs:8000/api/v1>
{"message":"invalid API endpoint"}
Niro
05/31/2023, 4:13 PMcurl <http://lakefs:8000/_health>
Robin Moffatt
05/31/2023, 4:13 PM# curl <http://lakefs:8000/_health>
alive! c0d5c906-e316-4029-b093-6b6057d079fc
Niro
05/31/2023, 4:15 PMjupyter-notebook | 23/05/31 16:05:39 DEBUG FsUrlStreamHandlerFactory: Creating handler for protocol http
jupyter-notebook | 23/05/31 16:05:39 DEBUG FsUrlStreamHandlerFactory: Unknown protocol http, delegating to default implementation
Unfortunately I'm not a spark expert.
Maybe @Yoni Augarten or @Ariel Shaqed (Scolnicov) can help?Ariel Shaqed (Scolnicov)
06/01/2023, 7:52 AMRobin Moffatt
06/01/2023, 8:20 AM