Hi here I have another issue when switching from a local pos lakeFS #help

Hi here, I have another issue when switching from ...

Xubo Fei

04/02/2021, 9:01 PM

Hi here, I have another issue when switching from a local postgresql server to Aurora PostgreSQL(Engine version 11.9) . Any idea what when wrong?

Copy code

time="2021-04-02T20:56:29Z" level=error msg="Failed to migrate" func="pkg/db.(*DatabaseMigrator).Migrate" file="build/pkg/db/migration.go:44" direction=up error="sql: Scan error on column index 0, name \"current_schema\": converting NULL to string is unsupported in line 0: SELECT CURRENT_SCHEMA()" host=<http://lakefs.charlie.kariusdx.com|lakefs.charlie.kariusdx.com> method=POST path=/api/v1/setup_lakefs request_id=6da192ba-ca43-4495-973c-4715afda9ad3 service_name=rest_api

Yoni Augarten

04/02/2021, 9:05 PM

Hey @Xubo Fei, perhaps you are using a non-default schema name in your connection string? If your database connection string in the lakeFS configuration includes the

search_path

parameter, you need to create this schema on your database.

Yoni Augarten

04/02/2021, 9:05 PM

For example, if your configuration includes

?search_path=my_schema

, you need to run

CREATE SCHEMA my_schema;

on your database.

Yoni Augarten

04/02/2021, 9:06 PM

Alternatively, drop the

search_path

parameter to use the default schema (usually called "public")

Xubo Fei

04/02/2021, 9:07 PM

Copy code

<postgres://lakefs:XXXXX@XXXX:5432/lakefs>

Yoni Augarten

04/02/2021, 9:08 PM

Looks good

Yoni Augarten

04/02/2021, 9:09 PM

Maybe the "lakefs" database does not exist

Xubo Fei

04/02/2021, 9:09 PM

(base) ~  psql -h localhost -p 5400 -U lakefs Password for user lakefs: psql (10.15, server 11.9) WARNING: psql major version 10, server major version 11. Some psql features might not work. SSL connection (protocol: TLSv1.2, cipher: ECDHE-RSA-AES256-GCM-SHA384, bits: 256, compression: off) Type “help” for help. lakefs=> \dn List of schemas Name | Owner --------+---------- public | postgres (1 row)

Yoni Augarten

04/02/2021, 9:09 PM

Did you create such a database / user?

Yoni Augarten

04/02/2021, 9:09 PM

thanks!

Xubo Fei

04/02/2021, 9:09 PM

yes

Yoni Augarten

04/02/2021, 9:10 PM

can you run

\l

Xubo Fei

04/02/2021, 9:10 PM

Copy code

lakefs=> \l
                                  List of databases
   Name    |  Owner   | Encoding |   Collate   |    Ctype    |   Access privileges
-----------+----------+----------+-------------+-------------+-----------------------
 lakefs    | postgres | UTF8     | en_US.UTF-8 | en_US.UTF-8 | =Tc/postgres         +
           |          |          |             |             | postgres=CTc/postgres+
           |          |          |             |             | lakefs=CTc/postgres
 postgres  | postgres | UTF8     | en_US.UTF-8 | en_US.UTF-8 |
 rdsadmin  | rdsadmin | UTF8     | en_US.UTF-8 | en_US.UTF-8 | rdsadmin=CTc/rdsadmin
 template0 | rdsadmin | UTF8     | en_US.UTF-8 | en_US.UTF-8 | =c/rdsadmin          +
           |          |          |             |             | rdsadmin=CTc/rdsadmin
 template1 | postgres | UTF8     | en_US.UTF-8 | en_US.UTF-8 | =c/postgres          +
           |          |          |             |             | postgres=CTc/postgres
(5 rows)

Yoni Augarten

04/02/2021, 9:11 PM

and how about

SELECT CURRENT_SCHEMA()

Xubo Fei

04/02/2021, 9:12 PM

Copy code

lakefs=> SELECT CURRENT_SCHEMA();
 current_schema
----------------

(1 row)

Yoni Augarten

04/02/2021, 9:12 PM

so you're not able for example to do

\dt

Xubo Fei

04/02/2021, 9:12 PM

Copy code

lakefs=> \dt
Did not find any relations.

Xubo Fei

04/02/2021, 9:13 PM

its empty database

Yoni Augarten

04/02/2021, 9:13 PM

And after running

SET search_path TO public

, does the output of

SELECT CURRENT_SCHEMA();

return something?

Xubo Fei

04/02/2021, 9:14 PM

Copy code

lakefs=> SET search_path TO public;
SET
lakefs=> SELECT CURRENT_SCHEMA();
 current_schema
----------------

(1 row)

Yoni Augarten

04/02/2021, 9:14 PM

I see

Yoni Augarten

04/02/2021, 9:15 PM

I will try to spin up an Aurora and see if I can reproduce this. Sorry for the inconvenience

Xubo Fei

04/02/2021, 9:15 PM

Copy code

lakefs=> SHOW search_path;
 search_path
-------------
 public
(1 row)

Xubo Fei

04/02/2021, 9:15 PM

Thanks Yoni.

Yoni Augarten

04/02/2021, 9:27 PM

I think the reason is, that the

lakefs

database is not owned by the user lakefs

Yoni Augarten

04/02/2021, 9:27 PM

Can you try to delete this database and re-create it with the lakefs user?

Xubo Fei

04/02/2021, 9:51 PM

progressed. but

Copy code

permission denied to create extension \"pgcrypto

Xubo Fei

04/02/2021, 9:51 PM

looks like it need some addtional permission

Yoni Augarten

04/02/2021, 9:52 PM

Yes, the user needs to have the CREATE permission on the database

Xubo Fei

04/02/2021, 9:58 PM

nice works now. Thanks for your help @Yoni Augarten!

🎉 1

Yoni Augarten

04/02/2021, 10:00 PM

Sure!

Yoni Augarten

04/02/2021, 10:00 PM

@Xubo Fei could you tell me what the problem was with the "CURRENT_SCHEMA" issue? For future reference

Xubo Fei

04/02/2021, 10:01 PM

as you suggested. the

lakefs

database is not owned by the user lakefs

Xubo Fei

04/02/2021, 10:02 PM

I dropped database and use lakefs user to create the db.

Yoni Augarten

04/02/2021, 10:02 PM

Great! Thanks

Yoni Augarten

04/02/2021, 10:02 PM

Please let us know if you run into any (more) issues

👍 1

Jennifer Cristina Evangelista Da Silva

04/18/2022, 7:25 PM

@Ingrid Rosselis Sant Ana Da Cunha

👀 1

14 Views

Open in Slack

Previous Next