Can big data use Ceph?
Can big data use Ceph?For example, can Hive Hbase Spark use Ceph? https://github.com/ceph/cephfs-hadoop is no longer maintain?
Have a search for cern and ceph. On Tuesday, December 22, 2020, fantastic2085 <fantastic2085@126.com> wrote:
Can big data use Ceph?For example, can Hive Hbase Spark use Ceph? https://github.com/ceph/cephfs-hadoop is no longer maintain? _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
I am not really familiar with spark, but I see it often used in combination with mesos. They currently implemented a csi solution that should enable access to ceph. I have been trying to get this to work[1] I assume being able to scale tasks with distributed block devices or the cephfs would get you into the right direction not? [1] https://www.mail-archive.com/user@mesos.apache.org/msg10745.html -----Original Message----- From: fantastic2085 [mailto:fantastic2085@126.com] Sent: 22 December 2020 11:29 To: ceph-users@ceph.io Subject: [ceph-users] Can big data use Ceph? Can big data use Ceph?For example, can Hive Hbase Spark use Ceph? https://github.com/ceph/cephfs-hadoop is no longer maintain? _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Ceph RGW is frequently used as a backing store for Hadoop and Spark (S3A connector). Matt On Tue, Dec 22, 2020 at 5:29 AM fantastic2085 <fantastic2085@126.com> wrote:
Can big data use Ceph?For example, can Hive Hbase Spark use Ceph? https://github.com/ceph/cephfs-hadoop is no longer maintain? _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
-- Matt Benjamin Red Hat, Inc. 315 West Huron Street, Suite 140A Ann Arbor, Michigan 48103 http://www.redhat.com/en/technologies/storage tel. 734-821-5101 fax. 734-769-8938 cel. 734-216-5309
participants (4)
-
Brian :
-
fantastic2085
-
Marc Roos
-
Matt Benjamin