Commit Graph

2013 Commits

Author SHA1 Message Date
580775b47c Removed unnecessary debug output 2023-06-07 20:48:50 -07:00
eab26a1e01 Fixed test setting for macOS 2023-06-07 20:48:34 -07:00
1910856c6c Remove wait and check loop from mk_test_file (#2175)
This appears to be some kind of eventual consistency check.  This
should have no effect given S3Proxy and recent AWS strong consistency.
Also it is likely ineffective given the other test object creation
operations.
2023-06-07 23:24:31 +09:00
4b3e715291 Always return nanoseconds from get_time helpers (#2174)
This makes Linux and macOS more consistent.
2023-05-30 18:52:55 +09:00
6ca5a24a7f Fix two inconsistency issues between stat cache and cache file (#2152)
* Fix inconsistency between stat cache file and cache file

We unlock stat cache file too early in FdEntity::Open(), and would
truncate cache file and update stat cache file, so there's a window that
stat cache doesn't reflect cache file status.

Suggested-by: Takeshi Nakatani <ggtakec@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>

* Mark pagelist as unloaded if cache file has been truncated

If cache file size doesn't match object size, the cache file might be
corrupted, so invalidate it and save new cache stat file.

Suggested-by: Takeshi Nakatani <ggtakec@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>

---------

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-05-30 18:39:50 +09:00
0d6b02090e Revert "Update curl.cpp: reduce memory cache use (#2157)" (#2170)
This reverts commit 5b487f651a.
2023-05-27 20:33:43 +09:00
5b487f651a Update curl.cpp: reduce memory cache use (#2157)
flush the file and clean the page cache when filepart download done
2023-05-27 19:15:47 +09:00
e7a364d610 Specify _FORTIFY_SOURCE=3 (#2168)
This can find more kinds of buffer overflows:

https://developers.redhat.com/articles/2022/09/17/gccs-new-fortification-level
2023-05-27 17:20:29 +09:00
161be3ff33 Update ChangeLog and configure.ac for 1.92 (#2166) v1.92 2023-05-22 08:25:50 +09:00
1fc0e52dc3 Fixed mount point stat flag to be thread safe 2023-05-21 13:46:06 +09:00
7bf4ca1837 Add Fedora 38 and remove 36 from CI (#2160) 2023-05-14 13:41:12 +09:00
59c3b26655 Fix clang-tidy 16 nits (#2158) 2023-05-14 01:59:26 +09:00
8296fe32cb Directly and simplify requests in mount point checks (#2155) 2023-05-14 01:29:24 +09:00
4a15699669 Disabled to run github action for macos (#2154) 2023-05-08 20:29:20 +09:00
24b990d899 Disabled to run github action for macos (#2154) 2023-05-08 20:28:41 +09:00
ca9a257eec Allow mount points without directory objects by compat_dir (#2153) 2023-05-07 09:15:27 +09:00
6d4bb59865 Corresponded to upload in case of calling release without flush (#2150) 2023-04-23 22:59:04 +09:00
9b75abfbe6 New option: bucket_size (#2148)
* Added bucket_size option
2023-04-23 14:04:38 +09:00
c4f95f14cb Fixed a bug about attributes of mount point (#2147) 2023-04-15 14:34:39 +09:00
9c74014443 Fixed a bug in handling file names containing CR(0x1D) (#2136) 2023-03-26 13:19:16 +09:00
a25cb9e07a Fixed a bug when reading a reduced file without flushing (#2133) 2023-03-26 11:45:21 +09:00
2cd7c94653 Fixed configure.ac by autoupdate (#2134) 2023-03-21 15:10:55 +09:00
9648eba5bb Changed to rename cache files when renaming large files (#2135) 2023-03-21 14:15:34 +09:00
18495c44aa Added cache clearing on upload error (#2127) 2023-03-13 21:22:13 +09:00
4f22354aae Fix an error to calculate no data page bytes (#2122)
Co-authored-by: Takeshi Nakatani <ggtakec@gmail.com>
2023-03-11 17:23:56 +09:00
9d00b8d4a8 Fixed segmentation fault caused by file write failure (#2123) 2023-03-11 16:45:56 +09:00
aeacd0a7d3 Updated README.md(feat #2109) (#2115) 2023-03-05 15:03:48 +09:00
526700f2de Updated files for support ALPINE v3.17 (#2116) 2023-03-05 13:30:59 +09:00
a25a9450a6 Fixed to fail when the mount point directory is not existed (#2114) 2023-03-05 13:03:48 +09:00
f8a825e9b9 multipart upload id is converted by url encode (#2097) 2023-02-18 11:40:25 +09:00
dbddd762a9 Fixed token update process using ext-cred library (#2101) 2023-02-18 09:49:05 +09:00
e715b77307 Added the function to update mtime/ctime of the parent directory (#2016) 2023-02-12 17:59:40 +09:00
d1388ff446 Added proxy and proxy_cred_file option 2023-02-08 21:53:34 +09:00
38e8a830c9 Fixed a deadlock bug when specifying iam role(IAMv2) 2023-01-31 20:53:39 +09:00
7605c2e8fb Updated help contents and man pages for streamupload and etc 2023-01-31 20:53:20 +09:00
16bc44948e Retry BucketCheck containing directory paths 2023-01-09 21:18:47 +09:00
e4f85c1e08 Fixed renaming bug with SSE 2023-01-09 21:17:48 +09:00
222110e153 Fixed a bug about multipart upload with SSE 2023-01-07 09:12:55 +05:30
a40004f9cc Fixed a conflict between curl and curl-minimal on RockyLinux 9 (#2086) 2023-01-04 22:18:28 +09:00
0ba49518e9 Make some methods and parameters const (#2078)
This requires making some locks mutable.
2023-01-04 20:23:39 +09:00
14eb1a7fd8 Update readme, mac instructions, on M1 2022-12-07 07:46:17 +09:00
23a8124c51 Compatible with OpenSSL 3.0 2022-11-27 21:46:08 +09:00
f5af9dc4e2 Updated issue and pull request github templates 2022-11-23 21:58:21 +09:00
d8e4e34b74 Fixed a warning by compiling on fedora 37 2022-11-23 21:57:31 +09:00
d98fdf4b2e Fix man page inaccuracies 2022-11-22 22:47:11 +09:00
4e5f17e907 Fixed test_posix_acl test 2022-11-22 22:31:02 +09:00
38cdaeb191 Added Fedora:37 and RockyLinux:9 to Github Actions target OS 2022-11-22 22:30:30 +09:00
956eb77369 Updates for clang-tidy 15 (#2058) 2022-11-21 23:29:35 +09:00
465986e397 Fixed a bug when end of path for mount point is multi slash (#2057) 2022-11-19 15:07:27 +09:00
23a5583a7f Updated actions/checkout for gha from v2 to v3 (#2053) 2022-11-05 15:08:42 +09:00