- ceph-users - lists.ceph.io

10 Helpful Applications for Students
by elianajones117＠gmail.com 08 Sep '20

08 Sep '20

Here is the rundown of the best applications accessible on Google Play Store and App store for the understudy:- 1. Note Taking 2. Writing Paper 3. Screen Recorder 4. Study Groups 5. Programming 6. Health 7. Presentations 8. Time Management 9. Math 10. Career Tools Regards: [url=http://uscomoffice.com/setup/]Office.com/Setup[/url] | [url=http://go-mcafeecomactivate.com/]McAfee.com/Activate[/url]

4 4

how to write a good essay
by 27nick1993＠gmail.com 08 Sep '20

08 Sep '20

Are you busy and do not have time to handle your assignment? Are you scared that your paper will not make the grade? Do you have responsibilities that may hinder you from turning in your assignment on time? Are you tired and can barely handle your assignment? Are your grades inconsistent? Whichever your reason may is, it is valid! You can get professional academic help from our service https://helpinhomework.org/essay-writing-services at affordable rates. We have a team of professional academic writers who can handle all your assignments. Why choose our academic writing service? Plagiarism free papers Timely delivery Any deadline Skilled, Experienced Native English Writers Subject-relevant academic writer Adherence to paper instructions Ability to tackle bulk assignments Reasonable prices 24/7 Customer Support Get superb grades consistently Post your assignment Now on https://helpinhomework.org/essay-writing-services

1 0

Release mental stress using Hong Kong Assignment help
by james wick 08 Sep '20

08 Sep '20

Many students can’t complete their assignments within the assigned date because of some unavoidable circumstances in Hong Kong. It’s true that your mental stress raises hindrance and disturbs your concentration for your work. Because of stress and tension, you will not have enough thoughts to make your work effective. This situation directs you to the platform of Assignment Help services even in Hong Kong. This is because an unstable mind could not generate the right ideas to compose a worthy assignment. Make your assignment informative and productive using the online writing services of assignment experts. Professionals have a better understanding of the subject and know how to frame all information in the right format. So, you can use online assignment help when you have issues in composing your academic papers irrespective of any subject. https://www.greatassignmenthelp.com/hk/

4 3

How to deal with "inconsistent+failed_repair" pgs on cephfs pool ?
by Kári Bertilsson 08 Sep '20

08 Sep '20

Hello I have a couple of pgs with inconsitent+failed_repair after trying "ceph pg repair" on them. All the OSD's are using bluestore. These pgs belong to an erasure coded pool that runs cephfs. I did manage to find details about which objects are inconsistent by using the "rados list-inconsistent-obj pgid --format=json-pretty" But I am wondering how to find which files the corrupt objects belong to ? Also since I am guessing there is no way to recover these objects i will need to delete them to get back to active+clean status. What is the best way to delete the corrupt objects ? Best regards, Kári

1 0

Messenger v2 and IPv6-only still seems to prefer IPv4 (OSDs stuck in booting state)
by Wido den Hollander 08 Sep '20

08 Sep '20

Hi, Last night I've spend a couple of hours debugging a issue where OSDs would be marked as 'up', but then PGs stayed in the 'peering' state. Looking through the admin socket I saw these OSDs were in the 'booting' state. Looking at the OSDMap I saw this: osd.3 up in weight 1 up_from 26 up_thru 700 down_at 0 last_clean_interval [0,0) [v2:[2a05:xx0:700:2::7]:6816/7923,v1:[2a05:xx:700:2::7]:6817/7923,v2:0.0.0.0:6818/7923,v1:0.0.0.0:6819/7923] [v2:[2a05:xx:700:2::7]:6820/7923,v1:[2a05:1500:700:2::7]:6821/7923,v2:0.0.0.0:6822/7923,v1:0.0.0.0:6823/7923] exists,up 786d3e9d-047f-4b09-b368-db9e8dc0805d In ceph.conf this was set: ms_bind_ipv6 = true public_addr = 2a05:xx:700:2::6 On true IPv6-only nodes this works fine. But on nodes where there is also IPv4 present this can (and will?) cause problems. It did not use tcpdump/wireshark to investigate, but it seems that the OSDs tried to contact each other. Using the 0.0.0.0 IPv4 address. After adding these settings the problems were resolved: ms_bind_msgr1 = false ms_bind_ipv4 = false This also disables msgrv1 as we didn't need it here. A cluster and clients all running Octopus. The OSDMap now showed: osd.3 up in weight 1 up_from 704 up_thru 712 down_at 702 last_clean_interval [26,701) v2:[2a05:xx:700:2::7]:6804/791503 v2:[2a05:xx:700:2::7]:6805/791503 exists,up 786d3e9d-047f-4b09-b368-db9e8dc0805d OSDs can back right away, PGs peered and the problems were resolved. Wido

2 1

Tips for Taking a Semester off From College
by serene.banks3＠gmail.com 07 Sep '20

07 Sep '20

For most students, faculty may be the top 4 or 5 decades in their lives. But, in addition, there are many students who get to school and begin to experience burnout or confusion on what they wish to do after college. Sometimes this may result in falling grades, or pupils questioning whether going to school was even the correct choice for them. In some specific situations, some individuals have even taken a semester off so as to recharge their batteries regain focus in their research. Even though this may be a good thing to do, it may also be a challenging choice to describe to parents, loved ones, friends, and fellow pupils. Listed here are tips/strategies for folks to make the most of their off time before going back to school to receive their level. In case you decide you wish to take some time off from college to clean your mind, you need to produce a plan to be able to market the idea for your parents. The strategy won't simply set their mind at ease, but additionally, it will be something which you can return on during the session to keep you on course. You should think about your strategy nearly just like a business program. Be certain you account for the motives which you're taking time off and everything you intend on doing during each period of the time off from college. It'll be an additional bonus if you're able to describe what sorts of lessons you'll be studying during every stage. Don't underestimate how important with a strategy could be. Parents may initially see your session off with stress since they will fear you will eliminate motivation to return to college. They generally have a substantial monetary investment tied to your academic achievement. And of course that the deficiency of a strategy will also cause an absence of private attention and inspiration on your own end. Obtain Work, Gain Expertise The very best thing you may do during your off time is get work. Whether it's paid or unpaid, awaken each morning and operate. The job doesn't need to be fulltime and if you're creative it doesn't even need to be working for someone else. There are loads of students who've tried their hands small start-up companies with varying levels of success. The most important goal regardless of what you are doing would be to obtain expertise and transferable skills which you can add to a resume. The occupation skills are not only going to help you build career-wise, but also give you a hand in interviews once it is possible to bet you will be asked the reason you chose off a semester and everything you did during this period of time. Your short term job might even allow you to concentrate on a profession or career path you had not considered before your fracture. Among the most difficult things to do throughout time away from faculty is to keep your brain self-evident. Though your classmates are ongoing to move to class, take examinations, and also write term papers, you'll be away in your grind doing something entirely different. To be able to keep on creating the intellectual portion of your mind, you need to keep on reading anything that's near you. Whether it's a paper, book, or something from the New York Times bestseller list, browse it. Whenever you're finished reading it, then attempt and find someone to talk about it with this it is possible to keep on practicing your critical thinking abilities. Do to do your very best to stay current with current affairs. View the news sometimes, or see websites like CNN to remain fresh on what's happening in the world. Another positive point to do would be create a reading list of publications inside your major. From the time you contact school, you'll be armed with knowledge and questions your classmates might not have . Preventing your intellectual side is only going to result in you needing to prevent return to college afterwards, which will only cause an overall demanding transition back to school. Among the gorgeous things about being at school is being subjected to various individuals from so many diverse areas. When you take off your time, it's very likely that you will return to exactly the identical region which you just grew up in, and also the exact very same thoughts to which you're constantly exposed previously. If you can, attempt to discover some opportunity to traveling to other regions throughout your break. It can wind up as a large trip to Europe or the Caribbean, or it might only be a trip from state to go to some relatives. In any circumstance, the excursion won't just keep you thrilled, but additionally, it will expand your horizons. Have a little time to take new areas of interest and speak to as many individuals as possible from the new places. In the end, it might never be as simple to travel as soon as you're back in school or the working world, take advantage of it. . .To Everybody During the time you're not at college, go out of the way to speak to as many individuals as you can. Speak with your parents. Speak with your pals. Speak with your loved ones. Speak with your classmates back in college. These new folks will let you break from your typical school social bubble, and also be exposed to new methods of believing. As tempting as it might be, don't sit home all day and play games or even watch tv. The very best approach to find out more about yourself is by interacting with different individuals in the external world. If you falling your semester maybe you need to use one of the official essay writing services like writepaperforme.review https://writepaperforme.review/

1 0

add debian buster stable support for ceph-deploy
by Jelle de Jong 07 Sep '20

07 Sep '20

Hello everybody, Can somebody add support for Debian buster and ceph-deploy: https://tracker.ceph.com/issues/42870 Highly appreciated, Regards, Jelle de Jong

6 8

Does Cash.app/help useful for discount?
by mary smith 07 Sep '20

07 Sep '20

Cash app to Cash app installment is normally moment and store effectively inside 10 seconds. Thus, you don't get a choice to drop the installment. On the off chance that there is any sum deducted from your record, at that point use Cash.app/help to get a discount. The sum appears for you when the sum is discounted by the beneficiary. https://www.cashapp-customerservice.com/

1 0

Recover pgs from failed osds
by Vahideh Alinouri 07 Sep '20

07 Sep '20

Ceph cluster is updated from nautilus to octopus. On ceph-osd nodes we have high I/O wait. After increasing one of pool’s pg_num from 64 to 128 according to warning message (more objects per pg), this lead to high cpu load and ram usage on ceph-osd nodes and finally crashed the whole cluster. Three osds, one on each host, stuck at down state (osd.34 osd.35 osd.40). Starting the down osd service causes high ram usage and cpu load and ceph-osd node to crash until the osd service fails. The active mgr service on each mon host will crash after consuming almost all available ram on the physical hosts. I need to recover pgs and solving corruption. How can i recover unknown and down pgs? Is there any way to starting up failed osd? Below steps are done: 1- osd nodes’ kernel was upgraded to 5.4.2 before ceph cluster upgrading. Reverting to previous kernel 4.2.1 is tested for iowate decreasing, but it had no effect. 2- Recovering 11 pgs on failed osds by export them using ceph-objectstore-tools utility and import them on other osds. The result followed: 9 pgs are “down” and 2 pgs are “unknown”. 2-1) 9 pgs export and import successfully but status is “down” because of "peering_blocked_by" 3 failed osds. I cannot lost osds because of preventing unknown pgs from getting lost. pgs size in K and M. "peering_blocked_by": [ { "osd": 34, "current_lost_at": 0, "comment": "starting or marking this osd lost may let us proceed" }, { "osd": 35, "current_lost_at": 0, "comment": "starting or marking this osd lost may let us proceed" }, { "osd": 40, "current_lost_at": 0, "comment": "starting or marking this osd lost may let us proceed" } ] 2-2) 1 pg (2.39) export and import successfully, but after starting osd service (pg import to it), ceph-osd node RAM and CPU consumption increase and cause ceph-osd node to crash until the osd service fails. Other osds become "down" on ceph-osd node. pg status is “unknown”. I cannot use "force-create-pg" because of data lost. pg 2.39 size is 19G. # ceph pg map 2.39 osdmap e40347 pg 2.39 (2.39) -> up [32,37] acting [32,37] # ceph pg 2.39 query Error ENOENT: i don't have pgid 2.39 *pg 2.39 info on failed osd: # ceph-objectstore-tool --data-path /var/lib/ceph/osd/*ceph-34* --op info --pgid 2.39 { "pgid": "2.39", "last_update": "35344'6456084", "last_complete": "35344'6456084", "log_tail": "35344'6453182", "last_user_version": 10595821, "last_backfill": "MAX", "purged_snaps": [], "history": { "epoch_created": 146, "epoch_pool_created": 79, "last_epoch_started": 25208, "last_interval_started": 25207, "last_epoch_clean": 25208, "last_interval_clean": 25207, "last_epoch_split": 370, "last_epoch_marked_full": 0, "same_up_since": 8347, "same_interval_since": 25207, "same_primary_since": 8321, "last_scrub": "35328'6440139", "last_scrub_stamp": "2020-08-19T12:00:59.377593+0430", "last_deep_scrub": "35261'6031075", "last_deep_scrub_stamp": "2020-08-17T01:59:26.606037+0430", "last_clean_scrub_stamp": "2020-08-19T12:00:59.377593+0430", "prior_readable_until_ub": 0 }, "stats": { "version": "35344'6456082", "reported_seq": "11733156", "reported_epoch": "35344", "state": "active+clean", "last_fresh": "2020-08-19T14:16:18.587435+0430", "last_change": "2020-08-19T12:00:59.377747+0430", "last_active": "2020-08-19T14:16:18.587435+0430", "last_peered": "2020-08-19T14:16:18.587435+0430", "last_clean": "2020-08-19T14:16:18.587435+0430", "last_became_active": "2020-08-06T00:23:51.016769+0430", "last_became_peered": "2020-08-06T00:23:51.016769+0430", "last_unstale": "2020-08-19T14:16:18.587435+0430", "last_undegraded": "2020-08-19T14:16:18.587435+0430", "last_fullsized": "2020-08-19T14:16:18.587435+0430", "mapping_epoch": 8347, "log_start": "35344'6453182", "ondisk_log_start": "35344'6453182", "created": 146, "last_epoch_clean": 25208, "parent": "0.0", "parent_split_bits": 7, "last_scrub": "35328'6440139", "last_scrub_stamp": "2020-08-19T12:00:59.377593+0430", "last_deep_scrub": "35261'6031075", "last_deep_scrub_stamp": "2020-08-17T01:59:26.606037+0430", "last_clean_scrub_stamp": "2020-08-19T12:00:59.377593+0430", "log_size": 2900, "ondisk_log_size": 2900, "stats_invalid": false, "dirty_stats_invalid": false, "omap_stats_invalid": false, "hitset_stats_invalid": false, "hitset_bytes_stats_invalid": false, "pin_stats_invalid": false, "manifest_stats_invalid": false, "snaptrimq_len": 0, "stat_sum": { "num_bytes": 19749578960, "num_objects": 2442, "num_object_clones": 20, "num_object_copies": 7326, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 2442, "num_whiteouts": 0, "num_read": 16120686, "num_read_kb": 82264126, "num_write": 19731882, "num_write_kb": 379030181, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 2861, "num_bytes_recovered": 21673259070, "num_keys_recovered": 32, "num_objects_omap": 2, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 152, "num_omap_keys": 16, "num_objects_repaired": 0 }, "up": [ 40, 35, 34 ], "acting": [ 40, 35, 34 ], "avail_no_missing": [], "object_location_counts": [], "blocked_by": [], "up_primary": 40, "acting_primary": 40, "purged_snaps": [] }, "empty": 0, "dne": 0, "incomplete": 0, "last_epoch_started": 25208, "hit_set_history": { "current_last_update": "0'0", "history": [] } } *pg 2.39 info on osd which import to it: # ceph-objectstore-tool --data-path /var/lib/ceph/osd/*ceph-37* --op info --pgid 2.39 PG '2.39' not found 2-3) 1 pg (2.79) is lost! This pg is not found on any of three failed osds (osd.34 osd.35 osd.40)! status is “unknown”. pg 2.79 export is failed: " PG '2.79' not found" # ceph pg map 2.79 Error ENOENT: i don't have pgid 2.79 # ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-34 --op info --pgid 2.79 PG '2.79' not found 3- Using https://gitlab.lbader.de/kryptur/ceph-recovery/tree/master but it does not work for recent ceph versions and tested on “hammer” release. 4- Using https://ceph.io/planet/recovering-from-a-complete-node-failure/ but in lvm scenario I could not mount failed osd lv to new /var/lib/ceph/osd/ceph-x* .*Could not prepare and activate new osd to failed osd disk. 5- Setting pool min_size=1 that down pgs belong to it, restart osds that pgs import to them but no changes. 6- Seting pool min_size=1 that pg 2.39 belong to it, restart osds that pg import to them but no changes. 7- Repairing failed osds using ceph-objectstore-tools, making “in” and starting them but no changes. # ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-x --op repair 8- Repairing 2 unknown pgs, but no changes. # ceph pg repaire 2.39 # ceph pg repair 2.79 9- Forcing recovery 2 unknown pgs, but no changes. # ceph pg force-recovery 2.39 # ceph pg force-recovery 2.79 10- Check PID count in ceph-osd nodes because of osd services failed to start. kernel.pid.max = 4194304 11- Raising osd_op_thread_suicide_timeout=900, but no change.

3 12

Re: PG number per OSD
by norman 07 Sep '20

07 Sep '20

The current OSD's size and pg_num? Are you using the different size OSDs? On 6/9/2020 上午1:34, huxiaoyu(a)horebdata.cn wrote: > Dear Ceph folks, > > As the capacity of one HDD (OSD) is growing bigger and bigger, e.g. from 6TB up to 18TB or even more, should the number of PG per OSD increase as well, e.g. for 200 to 800. As far as i know, the capacity of each PG should be set smaller for performance reasons due to the existence of PG locks, thus shall i set the number of PGs per OSD to 1000 or even 2000? what is the actual reason for not setting the number of PGs per OSD? Is there any practical limations on the number of PGs? > > thanks a lot, > > Samuel > > > > > huxiaoyu(a)horebdata.cn > _______________________________________________ > ceph-users mailing list -- ceph-users(a)ceph.io > To unsubscribe send an email to ceph-users-leave(a)ceph.io

1 0