Commit Graph

2330 Commits

Author SHA1 Message Date
be28fbc7b8 Refactor StatCache words from NoObject to Negative 2025-06-10 10:36:48 +09:00
778059279b Upgrade CI to Alpine 3.22 2025-06-09 21:11:34 +09:00
5bc46ff1ba Removed the RUN_DIR variable which is no longer global 2025-06-09 21:10:42 +09:00
47231fc5fb Disable new S3 checksums for S3Proxy compatibility (#2686)
References aws/aws-cli#9214.
2025-06-09 19:31:46 +09:00
f1a954cbcb Refactor StatCache truncate processing 2025-06-08 23:51:31 +09:00
c620262d3d Fixed s3fs_flush to update pending meta for macos and nomultipart mode 2025-06-08 22:05:50 +09:00
63402bb556 Fixed the random string generation in test script for macos 2025-06-08 22:03:56 +09:00
c869b3996f Improve error handling (#2671)
Found via C++17 [[nodiscard]].
2025-06-07 14:58:06 +09:00
0e5bccc20b Simplify temporary file handling in CI scripts (#2680) 2025-06-07 14:56:32 +09:00
872f53d35a Remove Ubuntu 20.04 from CI (#2677)
This is EOL:
https://ubuntu.com/blog/ubuntu-20-04-lts-end-of-life-standard-support-is-coming-to-an-end-heres-how-to-prepare
2025-06-07 14:45:33 +09:00
109c968baa Changed some INFO level log messages to DBG level 2025-06-07 00:16:44 +09:00
3d6975b369 Fixed a bug when changing fdentity to a temporary path 2025-05-22 03:04:03 +09:00
f2542f22fe Require C++14 (#2596)
This only has some minor additions of std::make_unique, digits
separators, std::string literals, and more flexible constexpr.
References #2469.
2025-05-18 12:34:53 +09:00
3421025074 Use region instead of endpoint for configuration (#2669)
This is more consistent with the AWS docs.  Generally endpoint refers
to an HTTP URL not just the region.  Fixes #2668.
2025-05-18 10:49:35 +09:00
43f49b15e8 Reduce use of awk in tests (#2662) 2025-04-20 10:03:07 +09:00
093d223799 Use Fedora 42 for other CI functions (#2661) 2025-04-20 09:59:52 +09:00
853404a3ce Upgrade Alpine, OpenSuSE, Rocky, and Ubuntu to Java 21 (#2660) 2025-04-19 09:24:14 +09:00
30f9378dec Upgrade CI to Ubuntu 25.04 (#2659) 2025-04-19 09:21:39 +09:00
e083825f55 Upgrade CI to Fedora 42 (#2658)
Simplify argument parsing with cut to work around lack of awk.
2025-04-18 23:45:07 +09:00
22ca6ba6ee Updated CI test result for macos about updating xattr 2025-04-03 23:48:48 +09:00
04a82583d1 A case of HEAD response for mp is different on compatible storage 2025-04-02 23:04:27 -07:00
ad4646f027 Ask for the provider on support requests (#2652) 2025-04-02 22:59:03 +09:00
bfd27460cc Update COMPILATION.md
fix typo
2025-03-18 22:00:26 -07:00
ee1ff8ba75 Update COMPILATION.md
add hint for windows compilation
2025-03-18 22:00:26 -07:00
885b1efac6 change the way to get existing fdentity to optimize concurrent IO performance (#2623)
* change the way to get existing fdentity

* fix compiling err for ver > 1.91

* use GetROPath instead of GetPath

* compare FdEntity::ro_path first in FdEntity::GetFdEntityHasLock()

---------

Co-authored-by: fangqianan.fqa <fangqianan.fqa@alibaba-inc.com>
2025-03-01 01:56:07 +09:00
e63fe7ec65 Added backup variable for fdcache entity path (#2637) 2025-02-15 12:19:58 +09:00
dc92b1b087 Remove unneeded uses of std::map::operator[] (#2642)
These unintentionally mutate the map.  Script suggested by @danmar.
2025-02-09 11:21:44 +09:00
edf4141ad6 Updated to the new issue template workflow 2025-01-26 11:51:10 -08:00
dd4f1395ca Run passing tests from pjdfstest (#1882)
This downloads a tarball by hash instead of using a submodule.
References #1589.
2025-01-19 10:26:40 +09:00
84dcf34e2c Fixed refactoring mistakes about loading IAM credentials 2025-01-19 03:24:30 +09:00
b679e1db98 Fixed memory leak found by valgrind 2025-01-19 03:22:11 +09:00
be183c0323 Pin AWS CLI to work around S3Proxy limitation (#2633)
Also specify architecture to allow future ARM64 CI to work.
2025-01-18 10:56:18 +09:00
3df1195ae5 Expand clang-tidy CI target to all static-checks (#2625)
Relocate cppcheck and Shellcheck into a single CI target instead of
running them as part of all distributions.  While this modestly
reduces run-time by about 20 seconds, more importantly it avoids
workarounds for older checker versions and simplifies the code.
2025-01-03 15:04:58 +09:00
cd41bddd1e Upgrade to S3Proxy 2.5.0 (#2627)
Release notes:

https://github.com/gaul/s3proxy/releases/tag/s3proxy-2.5.0
2025-01-03 15:01:15 +09:00
87874caf95 Remove double free in DestroyCurlShareHandle (#2626)
ShareHandles.erase implicitly calls this via the unique_ptr
destructor.
2025-01-03 14:59:06 +09:00
b83c2852b8 Upgrade CI to Alpine 3.21 (#2620) 2024-12-15 10:19:29 +09:00
5e39eff403 Remove explicit std::string constructors (#2619)
char * automatically convert via the implicit std::string constructor.
2024-12-15 10:18:44 +09:00
6c77cd8780 Fixed a bug in check_service_req_threadworker 2024-12-15 09:51:42 +09:00
669cba3240 Address some 32-bit warnings (#2615) 2024-12-01 10:32:28 +09:00
d4f3fb01fc Make some methods const (#2614)
Found via cppcheck --inconclusive.
2024-12-01 10:31:03 +09:00
65e4aef2a1 Prefer C++-style casts over C-style casts (#2599)
The former are easier to identify.  Found via clang-tidy.

Co-authored-by: Takeshi Nakatani <ggtakec@gmail.com>
2024-12-01 10:29:08 +09:00
d13396127c Delete Semaphore copy and move methods (#2613)
This matches the macOS implementation.
2024-12-01 10:28:50 +09:00
990d2e0074 Add top-level clang-tidy make target 2024-11-30 03:59:40 +09:00
61abf80197 Organized multi-threading related options 2024-11-29 05:13:06 +09:00
956e8c5750 Added new class for curl share handle
Added new class for curl share handle.
And, paired the curl handle(S3fsCurl) with the worker thread.
Changed that each thread has its own SSL session cache to prevent data
races.
So OpenSSL suppression for ThreadSanitizer is no longer necessary, so
reverted it.
2024-11-28 03:40:40 +09:00
bfc3ea767a Removed last use of S3fsMultiCurl and changed those thread handling 2024-11-26 10:47:03 +09:00
499577c2a9 Refactored for standardizing content and copy handling for Multipart Upload 2024-11-25 05:48:38 +09:00
143284b2f3 Upgrade to S3Proxy 2.4.1 (#2433)
This transitions to the transient-nio2 storage backend which should
address a race condition with getBlob and be easier to work with in
the future.  Release notes:

https://github.com/gaul/s3proxy/releases/tag/s3proxy-2.4.1
https://github.com/gaul/s3proxy/releases/tag/s3proxy-2.4.0
https://github.com/gaul/s3proxy/releases/tag/s3proxy-2.3.0
https://github.com/gaul/s3proxy/releases/tag/s3proxy-2.2.0
https://github.com/gaul/s3proxy/releases/tag/s3proxy-2.1.0
2024-11-24 22:27:24 +09:00
7410b95db2 Refactored parallel get object request 2024-11-23 02:22:27 +09:00
86b5c9d88e Refactored multipart put head request 2024-11-16 09:35:23 +09:00