Commit Graph

2353 Commits

Author SHA1 Message Date
0448ff460b Add S3 operation performance counters (#2715)
These can be used to evaluate changes like #2707.  Ideally tests could
assert how many operations they expect although this will require a
localhost HTTP server.
2025-08-30 16:13:30 +09:00
28771e5757 Changed to use rename when serializing to FileCacheStat 2025-08-30 01:21:13 +09:00
da17cace4f Fixed test_update_time_chown in test (#2720) 2025-08-29 03:11:18 +09:00
87d7a5822e Use curl instead of AWS CLI (#2689)
The latter starts up significantly slower which impedes integration
test times.  curl has some limitations, e.g., no SSE support.
2025-08-28 08:36:07 +09:00
e8b5a4109a Remove unused pip dependency (#2711)
df7bbb28d5 removed the use of this.
Also convert string to an array to reduce merge conflicts and
alphabetize packages for readability.
2025-08-27 08:25:38 +09:00
bae0facba3 Changed to serialize CacheFileStat after flushing a file 2025-08-26 16:54:39 +09:00
ecdcb4a836 Fixed unnecessary conversion to in DirStatCache::TruncateCacheHasLock (#2706) 2025-08-22 19:57:36 +09:00
066a2f8fa6 Added DirStatCache::GetChildLeafNameHasLock method 2025-08-22 06:48:06 +09:00
629207791e Remove unused S3FS_PTHREAD_ERRORCHECK (#2703) 2025-08-21 20:40:54 +09:00
b411e40d6b Add Debian trixie (#2702) 2025-08-21 20:36:17 +09:00
b1b9fb55d9 Use junk_data instead of urandom (#2700)
The latter seems to block on macOS sometimes.
2025-08-21 20:34:30 +09:00
666fea3d26 Remove unneeded x-prefix in comparisons
Found via shellcheck.  Reference:

https://www.shellcheck.net/wiki/SC2268
2025-08-21 06:11:03 +09:00
7112471a80 small spelling fix: 'no' to 'not' 2025-08-03 01:36:10 +09:00
50bb76f968 Remove S3FS_MALLOC_TRIM (#2699)
42b74c9d2e introduced this flag but it
is not clear that this behavior is required with recent libxml2
version.
2025-08-01 10:47:58 +09:00
c78517d410 Convert #if defined to #ifdef where possible (#2698)
Suggested by clang-tidy.
2025-08-01 10:43:44 +09:00
57b5d367f2 Deduplicate case-insensitive functors (#2697) 2025-07-29 22:28:06 +09:00
41ef4b6495 Convert s3fs_log_level to a strong enum (#2695) 2025-07-29 22:26:53 +09:00
0c559778bb Fixed typos in PR #2681 2025-07-29 10:53:24 +09:00
5a2a7ca4db Refactor to change StatCache class and add StatCacheNode classes 2025-07-25 03:45:27 +09:00
8faebbc7fc Add Rocky Linux 10 to CI (#2688) 2025-06-29 11:44:18 +09:00
8d68b8a03c Refactor to move functions and its declarations to appropriate files 2025-06-27 15:28:44 +09:00
97659c41f2 Fixed bugs in removing xattrs func and and test for it 2025-06-27 03:16:32 +09:00
b624596685 Simplify temporary file creation via mktemp (#2691)
Previously this used /dev/urandom which does not guarantee uniqueness
and sometimes blocked on macOS.  References #2690.
2025-06-26 19:05:16 +09:00
be28fbc7b8 Refactor StatCache words from NoObject to Negative 2025-06-10 10:36:48 +09:00
778059279b Upgrade CI to Alpine 3.22 2025-06-09 21:11:34 +09:00
5bc46ff1ba Removed the RUN_DIR variable which is no longer global 2025-06-09 21:10:42 +09:00
47231fc5fb Disable new S3 checksums for S3Proxy compatibility (#2686)
References aws/aws-cli#9214.
2025-06-09 19:31:46 +09:00
f1a954cbcb Refactor StatCache truncate processing 2025-06-08 23:51:31 +09:00
c620262d3d Fixed s3fs_flush to update pending meta for macos and nomultipart mode 2025-06-08 22:05:50 +09:00
63402bb556 Fixed the random string generation in test script for macos 2025-06-08 22:03:56 +09:00
c869b3996f Improve error handling (#2671)
Found via C++17 [[nodiscard]].
2025-06-07 14:58:06 +09:00
0e5bccc20b Simplify temporary file handling in CI scripts (#2680) 2025-06-07 14:56:32 +09:00
872f53d35a Remove Ubuntu 20.04 from CI (#2677)
This is EOL:
https://ubuntu.com/blog/ubuntu-20-04-lts-end-of-life-standard-support-is-coming-to-an-end-heres-how-to-prepare
2025-06-07 14:45:33 +09:00
109c968baa Changed some INFO level log messages to DBG level 2025-06-07 00:16:44 +09:00
3d6975b369 Fixed a bug when changing fdentity to a temporary path 2025-05-22 03:04:03 +09:00
f2542f22fe Require C++14 (#2596)
This only has some minor additions of std::make_unique, digits
separators, std::string literals, and more flexible constexpr.
References #2469.
2025-05-18 12:34:53 +09:00
3421025074 Use region instead of endpoint for configuration (#2669)
This is more consistent with the AWS docs.  Generally endpoint refers
to an HTTP URL not just the region.  Fixes #2668.
2025-05-18 10:49:35 +09:00
43f49b15e8 Reduce use of awk in tests (#2662) 2025-04-20 10:03:07 +09:00
093d223799 Use Fedora 42 for other CI functions (#2661) 2025-04-20 09:59:52 +09:00
853404a3ce Upgrade Alpine, OpenSuSE, Rocky, and Ubuntu to Java 21 (#2660) 2025-04-19 09:24:14 +09:00
30f9378dec Upgrade CI to Ubuntu 25.04 (#2659) 2025-04-19 09:21:39 +09:00
e083825f55 Upgrade CI to Fedora 42 (#2658)
Simplify argument parsing with cut to work around lack of awk.
2025-04-18 23:45:07 +09:00
22ca6ba6ee Updated CI test result for macos about updating xattr 2025-04-03 23:48:48 +09:00
04a82583d1 A case of HEAD response for mp is different on compatible storage 2025-04-02 23:04:27 -07:00
ad4646f027 Ask for the provider on support requests (#2652) 2025-04-02 22:59:03 +09:00
bfd27460cc Update COMPILATION.md
fix typo
2025-03-18 22:00:26 -07:00
ee1ff8ba75 Update COMPILATION.md
add hint for windows compilation
2025-03-18 22:00:26 -07:00
885b1efac6 change the way to get existing fdentity to optimize concurrent IO performance (#2623)
* change the way to get existing fdentity

* fix compiling err for ver > 1.91

* use GetROPath instead of GetPath

* compare FdEntity::ro_path first in FdEntity::GetFdEntityHasLock()

---------

Co-authored-by: fangqianan.fqa <fangqianan.fqa@alibaba-inc.com>
2025-03-01 01:56:07 +09:00
e63fe7ec65 Added backup variable for fdcache entity path (#2637) 2025-02-15 12:19:58 +09:00
dc92b1b087 Remove unneeded uses of std::map::operator[] (#2642)
These unintentionally mutate the map.  Script suggested by @danmar.
2025-02-09 11:21:44 +09:00