Commit Graph

2147 Commits

Author SHA1 Message Date
feb0845103 Use JDK 21 for Ubuntu 23.10 (#2380) 2023-11-27 00:55:35 +09:00
f041812939 Revert "Call C++11 get_time and put_time (#2375)" (#2381)
This reverts commit 10a72bfd0f.  These
commit is incompatible with older CentOS 7 libstdc++.
2023-11-27 00:51:17 +09:00
2b57e74330 Use std::unique_ptr in threadpoolman (#2374) 2023-11-26 01:49:17 +09:00
b671fa7a9c Pass std::unique_ptr by value (#2373)
This ensures that the parameter is moved.
2023-11-26 01:48:47 +09:00
691669749e Remove obsolete C++11 #ifdef (#2377) 2023-11-21 00:37:42 +09:00
10a72bfd0f Call C++11 get_time and put_time (#2375)
This removes workarounds and fixed-length buffers.
2023-11-20 18:45:27 +09:00
43f81b76af Enable clang-tidy CERT warnings (#2371) 2023-11-19 10:00:42 +09:00
68bbfee8ea Address clang-tidy modernize-deprecated-headers (#2370) 2023-11-19 10:00:16 +09:00
ec8caf64b8 Reverted the macos CI process(using macos-fuse-t) 2023-11-17 21:08:34 +09:00
bcacca6599 s3fs: make dir size not zero
Directory has size 0, which looks weired and may confuse users. So fake
dir size as 4k.

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-11-17 17:55:57 +09:00
4fdd2456d4 Fixed a script of not functioning environment in Github Actions 2023-11-15 23:17:26 +09:00
3f6e8a8707 Fixed indent in integration-test-main.sh 2023-11-15 23:15:40 +09:00
4845831f93 Convert some const to constexpr (#2342)
This guarantees that the function or value will resolve at compile-time.
2023-11-14 22:15:17 +09:00
919575f312 Upgrade CI to Fedora 39 (#2365) 2023-11-12 16:01:09 +09:00
0cd73e406d Address clang-tidy 17 warnings (#2362) 2023-11-12 11:48:08 +09:00
807ec1f6f7 Upgrade CI to Alpine 3.18 (#2332)
References #2328.
2023-11-12 11:08:44 +09:00
e2ac9b45e8 Re-improved updating of temporary stat cache when new file 2023-11-11 07:45:32 +09:00
b15ed13807 Force disk free space recovery in test(for only macos) 2023-11-10 15:51:22 +09:00
f9d3941d9d Fixed a bug in the re-upload part of Streamupload 2023-11-10 10:41:26 +09:00
34c379babb Improved updating of temporary stat cache while creating a file 2023-11-10 10:23:15 +09:00
7b5111c955 Suppress some message levels on macos 2023-11-09 14:16:43 +09:00
a3964b3fcd Upgrade CI to Ubuntu 23.10 (#2355) 2023-10-22 22:18:29 +09:00
3856637cd2 s3fs: add option free_space_ratio to control cache size (#2351)
* Try to cleanup cache directory when initing without enough disk space

Also optimize log messages to print detailed errors to the user.

Signed-off-by: Qinqi Qu <quqinqi@linux.alibaba.com>

* s3fs: add option free_space_ratio to control cache size

Since the ensure_diskfree option is not convenient enough, we have added
a new option "-o free_space_ratio" to control the space used by the s3fs
cache based on the current disk size.

The value of this option can be between 0 and 100. It will control the
size of the cache according to this ratio to ensure that the idle ratio
of the disk is greater than this value.

For example, when the value is 10 and the disk space is 50GB, it will
ensure that the disk will reserve at least 50GB * 10% = 5GB of remaining
space.

Signed-off-by: Qinqi Qu <quqinqi@linux.alibaba.com>

---------

Signed-off-by: Qinqi Qu <quqinqi@linux.alibaba.com>
2023-10-20 18:11:47 +09:00
2871975d1e Set SSE headers when checking bucket 2023-10-18 21:45:47 +09:00
d5dd17644d Add a helper script to compile all targets (#2337)
This is useful to compile different SSL libraries and 32-bit targets.
2023-10-15 11:54:52 +09:00
5e5b4f0a49 Fixed ETag parsing at completing the Multipart upload part 2023-10-13 11:13:52 +09:00
e5b15bed7d Pass by value to trim functions (#2345)
These already force a copy so passing by value has the same
performance but is simpler.  But this allows the compiler to perform
copy elision on temporaries and the caller to explicitly std::move in
others.
2023-10-12 22:21:33 +09:00
2e4a6928c3 Changed argument name in ParallelMultipartUploadAll 2023-10-09 13:17:25 +09:00
1aa77f6cda s3fs_cred: print detailed error message when stat file fails
Signed-off-by: Qinqi Qu <quqinqi@linux.alibaba.com>
2023-10-09 13:11:47 +09:00
d0c4b5c763 Fixed a bug in exclusive control of pagelist in FdEntity class 2023-09-26 21:26:17 +09:00
361e10d09c Add scope_guard for ad-hoc resource management (#2313)
References #2261.  Suggested by:
https://stackoverflow.com/questions/10270328/the-simplest-and-neatest-c11-scopeguard
2023-09-26 07:52:55 +09:00
95cfbe30ed Add error checking to test_concurrent_writes (#2299)
This reveals a situation where s3fs triggers an unexpected
EntityTooSmall error.
2023-09-26 07:32:02 +09:00
87b8bafaea Address unknown pragma warning with GCC (#2324) 2023-09-26 01:16:14 +09:00
1a703e623a Remove volatile qualifiers deprecated in C++23 (#2323)
These are protected by upload_list_lock.  Addresses warnings of the
form:

warning: ‘++’ expression of ‘volatile’-qualified type is deprecated
2023-09-26 00:15:05 +09:00
1ebefca029 Reorder $CXXFLAGS to the end (#2322)
This allows overriding flags like -std=c++11.
2023-09-26 00:05:54 +09:00
ffff26e165 Add stat helper for user and group (#2320) 2023-09-26 00:04:24 +09:00
61df7bf42c Use std::unique_ptr for fclose (#2318)
References #2261.
2023-09-25 23:55:11 +09:00
c5fb42ff10 Use std::unique_ptr in libxml functions (#2317)
References #2261.
2023-09-25 23:46:52 +09:00
cbc33cd7ae Fixed a bug upload boundary calculation in StreamUpload 2023-09-25 09:28:37 +09:00
645c10a3c3 Fixed test_not_existed_dir_obj test condition 2023-09-25 08:16:32 +09:00
54293a66b3 Simplify the determination of the --cached option of the stat 2023-09-25 08:08:58 +09:00
01b3caa38c Fixed errors of cppcheck 2.12.0 2023-09-24 19:55:02 +09:00
64642e1d1b Do not cache stat attributes (#2319)
This is a workaround for CI failures.
2023-09-24 18:32:07 +09:00
546cdd0d91 Improve docs on environment variables 2023-09-21 12:40:46 +09:00
a83f4a48d0 Add extra logging to debug test (#2316) 2023-09-15 21:50:01 +09:00
99d3e68d59 Revert ls change (#2315)
echo does not split the words on newlines.
2023-09-15 21:48:04 +09:00
01189e99fc Store mvnode in vector instead of manual linked list (#2312)
This simplifies code and avoids manual memory management.  References #2261.
2023-09-13 22:32:15 +09:00
f493cb5846 Remove unnecessary uses of ls (#2311)
Other call sites need the call to readdir/getdents64.
2023-09-13 22:27:12 +09:00
e9814b4a4d Add Debian bookworm to CI 2023-09-11 00:59:23 +09:00
3b12aaf2ab Do not escape percent (#2310)
This addresses warnings of the form:

grep: warning: stray \ before %
2023-09-10 12:51:36 +09:00