error: APIError: ResponseError with 1006: invalid uri

[FearlessPeople]

I want to use databend to create a hive catalog for reading data from the hive data warehouse. The data in hive is stored on HDFS, and when I run the create catalog command, an error occurs

The command is as follows：

root@localhost:8000/test> CREATE CATALOG hive_hdfs_ctl TYPE = HIVE CONNECTION =(
  METASTORE_ADDRESS = '10.200.1.1:7004'
  URL = 'hdfs:///'
  NAME_NODE = 'hdfs://10.200.1.1:4007'
);
error: APIError: ResponseError with 1006: invalid uri
root@localhost:8000/test>
root@localhost:8000/test>

[BohuTANG]

@Xuanwo might be able to assist with this issue.

[Xuanwo]

Hi, can you post the full backtrace so we can know the error cuase?

[FearlessPeople]

I referred to this link and installed Databend in local format on Centos

https://docs.databend.cn/guides/deploy/deploy/non-production/deploying-local

The installed version is as follows

root@localhost:8000/test> select version();
SELECT
  version()
┌────────────────────────────────────────────────────────────────────────────────────────┐
│                                        version()                                       │
│                                         String                                         │
├────────────────────────────────────────────────────────────────────────────────────────┤
│ Databend Query v1.2.453-d7c9a83f6b(rust-1.77.0-nightly-2024-05-06T12:12:52.098125960Z) │
└────────────────────────────────────────────────────────────────────────────────────────┘
1 row read in 0.007 sec. Processed 1 row, 1 B (135.56 rows/s, 135 B/s)

root@localhost:8000/test>

Next, I want to test the performance of querying hive data through Databend, where hive data is stored in HDFS

https://www.databend.cn/blog/databend-with-hive/

I started creating a catalog

root@localhost:8000/test> CREATE CATALOG hive_hdfs_ctl TYPE = HIVE CONNECTION =(
  METASTORE_ADDRESS = '10.200.1.1:7004'
  URL = 'hdfs:///'
  NAME_NODE = 'hdfs://10.200.1.1:4007'
);
error: APIError: ResponseError with 1006: invalid uri
root@localhost:8000/test>
root@localhost:8000/test>

After running the code, I received an error

This makes it impossible for me to proceed to the next step

Thank you for your help

[Xuanwo]

I referred to this link and installed Databend in local format on Centos

Hi, Please start databend with RUST_BACKTRACE=full and it will prive the backtrace while error like APIError happened. Please visit the log and upload it here.

[FearlessPeople]

My steps are as follows

1. Databend was installed using a non root user (in this case, test user pet)
2. Using pet, the user has set the environment variable export RUST BackTRACE="full"
3. Then execute the CREATE CATALOG statement
   Next, I received an error: APIError: ResponseError with 1006: invalid uri

cat meta.log

[pet@10 /data/app/databend]$ cat meta.log
Databend Metasrv

Version: v1.2.453-d7c9a83f6b-simd(1.77.0-nightly-2024-05-06T12:19:46.770323284Z)
Working DataVersion: V002(2023-07-22: Store snapshot in a file)

Raft Feature set:
    Server Provide: { append:v0, install_snapshot:v0, install_snapshot:v1, install_snapshot:v2, vote:v0 }
    Client Require: { append:v0, install_snapshot:v0, vote:v0 }

On Disk Data:
    Dir: /data/app/databend/raft
    DataVersion: V002(2023-07-22: Store snapshot in a file)
    In-Upgrading: None

Log:
    File: enabled=true, level=WARN, dir=/data/app/databend/logs, format=text
    Stderr: enabled=false(To enable: LOG_STDERR_ON=true or RUST_LOG=info), level=INFO, format=text
    OTLP: enabled=false, level=INFO, endpoint=http://127.0.0.1:4317, labels=
    Tracing: enabled=false, capture_log_level=INFO, otlp_endpoint=http://127.0.0.1:4317
Id: 1
Raft Cluster Name: foo_cluster
Raft Dir: /data/app/databend/raft
Raft Status: single

HTTP API
   listening at 0.0.0.0:28101
gRPC API
   listening at 0.0.0.0:9191
   advertise:  127.0.0.1:9191
Raft API
   listening at 127.0.0.1:28103
   advertise:  localhost:28103

Wait for 180s for active leader...
Leader Id: 1
    Metrics: id=1, Leader, term=1, last_log=Some(2871), last_applied=Some(1-1-2871), membership={log_id:Some(1-1-3), {voters:[{1:EmptyNode}], learners:[]}}

Register this node: {id=1 raft=localhost:28103 grpc=127.0.0.1:9191}

    Register-node: Ok

Databend Metasrv started

cat query.log

[pet@10 /data/app/databend]$ cat query.log
Databend Query

Version: v1.2.453-d7c9a83f6b(rust-1.77.0-nightly-2024-05-06T12:12:52.098125960Z)

Logging:
    file: enabled=true, level=WARN, dir=/data/app/databend/logs, format=text
    stderr: enabled=false(To enable: LOG_STDERR_ON=true or RUST_LOG=info), level=INFO, format=text
    otlp: enabled=false, level=INFO, endpoint=http://127.0.0.1:4317, labels=
    query: enabled=false, dir=, otlp_endpoint=, labels=
    tracing: enabled=false, capture_log_level=INFO, otlp_endpoint=http://127.0.0.1:4317
Meta: connected to endpoints [
    "0.0.0.0:9191",
]
Memory:
    limit: unlimited
    allocator: jemalloc
    config: percpu_arena:percpu,oversize_threshold:0,background_thread:true,dirty_decay_ms:5000,muzzy_decay_ms:5000
Cluster: standalone
Storage: fs | root=/data/app/databend/data_path
Cache: none
Builtin users: root

Admin
    listened at 0.0.0.0:8081
MySQL
    listened at 0.0.0.0:3307
    connect via: mysql -u${USER} -p${PASSWORD} -h0.0.0.0 -P3307
Clickhouse(http)
    listened at 0.0.0.0:8124
    usage:  echo 'create table test(foo string)' | curl -u${USER} -p${PASSWORD}: '0.0.0.0:8124' --data-binary  @-
echo '{"foo": "bar"}' | curl -u${USER} -p${PASSWORD}: '0.0.0.0:8124/?query=INSERT%20INTO%20test%20FORMAT%20JSONEachRow' --data-binary @-
Databend HTTP
    listened at 0.0.0.0:8000
    usage:  curl -u${USER} -p${PASSWORD}: --request POST '0.0.0.0:8000/v1/query/' --header 'Content-Type: application/json' --data-raw '{"sql": "SELECT avg(number) FROM numbers(100000000)"}'

databend-meta-1@foo_cluster.2024-05-10-01

[pet@10 /data/app/databend]$ cat logs/databend-meta-1\@foo_cluster.2024-05-10-01
2024-05-10T01:48:34.880914Z  WARN databend_meta::api::http_service: src/meta/service/src/api/http_service.rs:129 Http API TLS not set

databend-query-default.2024-05-10-01

[pet@10 /data/app/databend]$ cat logs/databend-query-default.2024-05-10-01
2024-05-10T01:48:37.891192Z  WARN databend_query::servers::admin::admin_service: src/query/service/src/servers/admin/admin_service.rs:162 Http API TLS not set
2024-05-10T01:48:37.892367Z  WARN databend_query::clusters::cluster: src/query/service/src/clusters/cluster.rs:321 Detected loopback or unspecified address as cluster flight endpoint. We rewrite it("0.0.0.0:9091" -> "127.0.0.1:9091") for advertising to other nodes. If there are proxies between nodes, you can specify endpoint with --flight-api-address.
2024-05-10T01:51:31.491239Z  WARN databend_query::servers::http::v1::query::http_query_manager: src/query/service/src/servers/http/v1/query/http_query_manager.rs:155 http query 4217e99a-5297-4392-a222-b5b7b0d98e17 timeout after 60 s
[pet@10 /data/app/databend]$

CREATE CATALOG

[pet@10 /data/app/databend]$ bendsql
Welcome to BendSQL 0.17.2-4a16544(2024-05-06T06:43:48.034101965Z).
Connecting to localhost:8000 as user root.

Connected to Databend Query v1.2.453-d7c9a83f6b(rust-1.77.0-nightly-2024-05-06T12:12:52.098125960Z)

root@localhost:8000/default>
root@localhost:8000/default> CREATE CATALOG hive_hdfs_ctl TYPE = HIVE CONNECTION =(
  METASTORE_ADDRESS = '10.202.10.10:7004'
  URL = 'hdfs:///'
  NAME_NODE = 'hdfs://10.202.10.10:4007'
);
error: APIError: ResponseError with 1006: invalid uri
root@localhost:8000/default>

[Xuanwo]

Thanks a lot for the context. I will try to reproduce this issue.