Skip to content

[Bug] 2.0.11版本的doris使用export导出数据报错 #60227

@1232445354

Description

@1232445354

Search before asking

  • I had searched in the issues and found no similar issues.

Version

type:RUN_FAIL; msg:errCode = 2, detailMessage = (172.21.30.245)[INTERNAL_ERROR]IOError: [INTERNAL_ERROR]Failed to allocate s3 writer buffer for 60 seconds

0#  doris::io::S3FileBuffer::append_data(doris::Slice const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:701
1#  doris::io::S3FileWriter::appendv(doris::Slice const*, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:446
2#  doris::vectorized::ParquetOutputStream::Write(void const*, long) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:446
3#  arrow::io::Writable::Write(std::shared_ptr<arrow::Buffer> const&)
4#  parquet::BufferedPageWriter::Close(bool, bool)
5#  parquet::ColumnWriterImpl::Close()
6#  parquet::RowGroupWriter::Close()
7#  doris::vectorized::VParquetWriterWrapper::write(doris::vectorized::Block const&) at /home/zcp/repo_center/doris_release/doris/be/src/vec/runtime/vparquet_writer.cpp:0
8#  doris::vectorized::VFileResultWriter::append_block(doris::vectorized::Block&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:446
9#  doris::vectorized::VResultFileSink::send(doris::RuntimeState*, doris::vectorized::Block*, bool) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:446
10# doris::PlanFragmentExecutor::open_vectorized_internal() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:441
11# doris::PlanFragmentExecutor::open() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:357
12# doris::FragmentExecState::execute() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/tuple:180
13# doris::FragmentMgr::_exec_actual(std::shared_ptr<doris::FragmentExecState>, std::function<void (doris::RuntimeState*, doris::Status*)> const&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:446
14# std::_Function_handler<void (), doris::FragmentMgr::exec_plan_fragment(doris::TExecPlanFragmentParams const&, std::function<void (doris::RuntimeState*, doris::Status*)> const&)::$_0>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:701
15# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
16# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562
17# start_thread
18# __clone

What's Wrong?

2.0.11doris 使用export多次导出表异常
type:RUN_FAIL; msg:errCode = 2, detailMessage = (172.21.30.245)[INTERNAL_ERROR]IOError: [INTERNAL_ERROR]Failed to allocate s3 writer buffer for 60 seconds

0#  doris::io::S3FileBuffer::append_data(doris::Slice const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:701
1#  doris::io::S3FileWriter::appendv(doris::Slice const*, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:446
2#  doris::vectorized::ParquetOutputStream::Write(void const*, long) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:446
3#  arrow::io::Writable::Write(std::shared_ptr<arrow::Buffer> const&)
4#  parquet::BufferedPageWriter::Close(bool, bool)
5#  parquet::ColumnWriterImpl::Close()
6#  parquet::RowGroupWriter::Close()
7#  doris::vectorized::VParquetWriterWrapper::write(doris::vectorized::Block const&) at /home/zcp/repo_center/doris_release/doris/be/src/vec/runtime/vparquet_writer.cpp:0
8#  doris::vectorized::VFileResultWriter::append_block(doris::vectorized::Block&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:446
9#  doris::vectorized::VResultFileSink::send(doris::RuntimeState*, doris::vectorized::Block*, bool) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:446
10# doris::PlanFragmentExecutor::open_vectorized_internal() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:441
11# doris::PlanFragmentExecutor::open() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:357
12# doris::FragmentExecState::execute() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/tuple:180
13# doris::FragmentMgr::_exec_actual(std::shared_ptr<doris::FragmentExecState>, std::function<void (doris::RuntimeState*, doris::Status*)> const&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:446
14# std::_Function_handler<void (), doris::FragmentMgr::exec_plan_fragment(doris::TExecPlanFragmentParams const&, std::function<void (doris::RuntimeState*, doris::Status*)> const&)::$_0>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:701
15# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
16# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562
17# start_thread
18# __clone

What You Expected?

正常导出

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions