mirror of
https://github.com/s3fs-fuse/s3fs-fuse.git
synced 2026-04-25 05:16:00 +03:00
[GH-ISSUE #305] Does it support mount a s3-ceph bucket as a file system? #159
Labels
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/s3fs-fuse#159
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @jindov on GitHub (Nov 30, 2015).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/305
I setup a ceph storage system with s3 api built-in and want to mount a ceph-bucket as a file-system to my server, does this tool support?and how to config it for custom storage?Thanks
@gaul commented on GitHub (Nov 30, 2015):
Mount a non-AWS S3 bucket via:
Note that you may need to use
-o nocopyapidepending on Ceph's support for copy object which older Ceph versions do not support.@higkoo commented on GitHub (Dec 3, 2015):
uname -a
Linux ceph 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt9-3~deb8u1 (2015-04-24) x86_64 GNU/Linux
ceph -v
ceph version 9.2.0 (bb2ecea240f3a1d525bcb35670cb07bd1f0ca299)
s3cmd --version
s3cmd version 1.6.0 # PASS
s3fs --version
Amazon Simple Storage Service File System V1.79(commit:8dbd5a3) with OpenSSL
Sucess
s3fs my-new-bucket-1 /mnt/s3 -o sigv2 -o use_path_request_style -o passwd_file=/root/.s3.pass -o url=http://shd-storage-3.bilibili.co -d@jindov commented on GitHub (Dec 4, 2015):
I'll try and report. Thank all
@jindov commented on GitHub (Dec 4, 2015):
Hi all, i test with my system and this is result:
I mounted and uploaded a file to bucket successfully but if I use a tool like logstash to output a real-time file, its timeout and occur error
This is my command:
@higkoo commented on GitHub (Dec 5, 2015):
The Performance of s3fs-fuse is pool , cause this error maybe.
You can test perfmon by fio , compare with local disk.
@jindov commented on GitHub (Dec 7, 2015):
@higkoo: Can u explain clearly? I connect and upload successfully but cannot write real-time log file
@ggtakec commented on GitHub (Dec 20, 2015):
@jindov I think, because the timeout error is occurred and over retry count from your log.
So that you can try to set "retries" option as 5 or 10, it is set 2 as default.
Thanks in advance for your help.
@mjbhaskar commented on GitHub (Nov 18, 2016):
I am new to Ceph and S3. Could you please tell me how I can build the url? url=https://HOST:PORT/.. I used this format and used url=http://hostname:80/. With this as the URL and the s3fs command options like above, s3fs is trying to resolve url=http://my-new-bucket.hostname:80/ and it fails to resolve. For a non AWS S3 service like Ceph S3 how would we build the URL ?
Here my rados gateway server hostname : hostname
port : 80 ( because it is using civetweb and not apache )
bucket name is : my-new-bucket.
To add, my s3fs version : Amazon Simple Storage Service File System 1.74
My mount line
sudo /usr/local/bin/s3fs my-new-bucket /mnt/s3/ -o nocopyapi -o url=http://hostname:80/ -o passwd_file=~/.passwd-s3fs -f --debug -o curldbg -o f2 -o use_cache=/tmp/cache
My version of s3fs does not have -o sigv2
Thanks in advance
@gaul commented on GitHub (Nov 18, 2016):
You need to pass
-o use_path_request_stylefor non-AWS implementations like Ceph. I encourage you to use the latest 1.80 release since we have fixed some data corruption bugs since 1.74@mjbhaskar commented on GitHub (Nov 18, 2016):
Great. Thank you very much for the quick response, the new version 1.8 worked. I could mount and write a file into the bucket successfully.
@f1-outsourcing commented on GitHub (May 6, 2018):
What about cephs multi tenant, you have to use urls like this, maybe we (you :)) can add option for this?
https://rgw.ceph.com:7480/tennant:bucket/file.txt
@gaul commented on GitHub (Mar 17, 2019):
@jindov did you resolve your issue? Several users report success when mounting ceph via s3fs. If so could you please close this issue?
@gaul commented on GitHub (Apr 9, 2019):
Closing due to inactivity. Please reopen if symptoms persist.