On a Luminous 12.2.10 cluster that is healthy and not in use, I am trying
to run rados bench tests but am finding that the read tests, both 'seq' and
'rand' often take far too long to complete and Im wondering how to diagnose
where the problem lies.
I populate the data with rados bench write as follows:
$ rados bench -p rbd -t 4 30 write --no-cleanup -b 4M
- this runs for 30 seconds as expected and exits.
Then I try to run 'seq' read tests and they never fully complete. the
"finished" column takes a very long time to catch up to the "started"
numbers and the test often runs far longer than the given time limit (is
that a bug in itself?).
$ rados bench -p rbd -t 4 10 seq
hints = 1
sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg
lat(s)
0 0 0 0 0 0 -
0
1 4 30 26 103.983 104 0.00539085
0.0157025
2 4 30 26 51.9923 0 -
0.0157025
3 4 30 26 34.6622 0 -
0.0157025
4 4 30 26 25.9968 0 -
0.0157025
5 4 30 26 20.7975 0 -
0.0157025
6 4 30 26 17.3313 0 -
0.0157025
7 4 30 26 14.8555 0 -
0.0157025
8 4 30 26 12.9986 0 -
0.0157025
9 4 30 26 11.5543 0 -
0.0157025
10 4 30 26 10.3989 0 -
0.0157025
...
At this point it continues for quite a while before it finally exits after
several minutes. The "avg MB/s" value trends down to 0 since all IO seems
to be stuck. 'rand' read testing is not faring any better. The health
remains "OK" during this process and Im not sure where to look to find the
bottleneck.
Thanks,
Wyllys Ingersoll
Hello there,
After configuring the dashboard according to
http://docs.ceph.com/docs/mimic/mgr/dashboard/#enabling-the-object-gateway-…
to use SSL and port 8443 (which works fine) I decided to use port 8443
for the API.
It seems that using port 8443 for the API causes the following issue:
2019-07-08 17:26:55.172 7f2f45f66700 0 mgr[dashboard] RGW REST API GET
timed out after 45 seconds
(url=http://th-dev-ceph-mon-tc01.priv.tgho.nl:8443/?format=json).
Traceback (most recent call last):
File "/usr/lib64/ceph/mgr/dashboard/rest_client.py", line 377, in
do_request
url, headers=self.headers, params=params, auth=self.auth)
File "/usr/lib/python2.7/site-packages/requests/sessions.py", line
476, in get
return self.request('GET', url, **kwargs)
File "/usr/lib64/ceph/mgr/dashboard/rest_client.py", line 39, in request
return super(TimeoutRequestsSession, self).request(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/requests/sessions.py", line
464, in request
resp = self.send(prep, **send_kwargs)
File "/usr/lib/python2.7/site-packages/requests/sessions.py", line
576, in send
r = adapter.send(request, **kwargs)
File "/usr/lib/python2.7/site-packages/requests/adapters.py", line
433, in send
raise ReadTimeout(e, request=request)
ReadTimeout:
HTTPConnectionPool(host='th-dev-ceph-mon-tc01.priv.tgho.nl', port=8443):
Read timed out. (read timeout=45)
I then used another port for API: ceph dashboard set-rgw-api-port
dashboard.8080
Furthermore, From the dashboard perspective, clicking on Object Gateway
⌄ then clicking either on Daemons / Users / Buckets I always get the
following message:
Please consult the documentation
<http://docs.ceph.com/docs/mimic/mgr/dashboard/#enabling-the-object-gateway-…>
on how to configure and enable the Object Gateway management functionality.
I have also attached a screenshot
Any advice is much appreciated! What am I missing?
--
Met vriendelijke groeten,
Valentin Bajrami
Target Holding
Not sure who to direct this to so asking here.
Varsha Rao has a PR [1] to add tox testing for the cephfs-shell as
part of the build testing. Unfortunately it seems this isn't done as
part of the jenkins build, probably because cephfs-shell is not an
install target for most platforms due to dependency issues.
cephfs-shell is currently only a valid target for Ubuntu 18.04+. I see
that jenkins is using Ubuntu for the build [2] but I'm not immediately
sure which flavor. Maybe enabling cephfs-shell builds is just
something that needs turned on the CMake flags for the jenkins build
(-DWITH_CEPHFS_SHELL)?
[1] https://github.com/ceph/ceph/pull/28239
[2] https://jenkins.ceph.com/job/ceph-pull-requests/28553/consoleFull
--
Patrick Donnelly, Ph.D.
He / Him / His
Senior Software Engineer
Red Hat Sunnyvale, CA
GPG: 19F28A586F808C2402351B93C3301A3E258DD79D
Hi Ernesto Puerta,
Thanks for your great helping hand
I want to create the jquery in component(frontend) which can send the
request to API(backend).
However, jquery seem to not be used in angular. I try to find the way
dashboard using to send query to backend api formerly.
May you know any way about this?
Thank you very much
Best regards
Hausiowen Nayu
Ernesto Puerta <epuertat(a)redhat.com> 於 2019年7月2日 週二 下午6:45寫道:
> Yes, that should work, in that case you may try to look for some Ubuntu
> repo with rados, and other dependencies.
>
> Ernesto Puerta
>
> He / Him / His
>
> Senior Software Engineer, Ceph
>
> Red Hat <https://www.redhat.com/>
> <https://www.redhat.com/>
>
>
> On Tue, Jul 2, 2019 at 12:12 PM seribe pasada <clear60enator(a)gmail.com>
> wrote:
>
>> Hi Ernesto Puerta,
>>
>> Thanks for your great helping hand, and rapid response.
>>
>> My environment for monitor is x86 but osd is arm.(os for ubuntu) Can I
>> run rhcs-dashboard?
>> I have installed the ceph-mimic before I built dashboard source code.(I
>> have checked the python-rados package which is existed actually)
>> Should I need any pre-built package?
>>
>>
>> Thank you very much
>>
>> Best regards
>> Hausiowen Nayu
>>
>> Ernesto Puerta <epuertat(a)redhat.com> 於 2019年7月2日 週二 下午5:36寫道:
>>
>>> You may try to get some pre-built packages with rados and other
>>> dependencies, but cannot say about ARM environment.
>>>
>>> Ernesto Puerta
>>>
>>> He / Him / His
>>>
>>> Senior Software Engineer, Ceph
>>>
>>> Red Hat <https://www.redhat.com/>
>>> <https://www.redhat.com/>
>>>
>>>
>>> On Tue, Jul 2, 2019 at 11:24 AM seribe pasada <clear60enator(a)gmail.com>
>>> wrote:
>>>
>>>> Hi Ernesto Puerta,
>>>>
>>>> Thanks for your great helping hand, and rapid response.
>>>> It's so sorry that I can't use rhcs-dashboard. Because I use the
>>>> environment of ubuntu and arm which can't use docker environment.
>>>> I try to use cmake to build all ceph source code but failed due to the
>>>> error "Looking for pthread_create - not found".
>>>> Can I only build the source code from /usr/lib/ceph/mgr?
>>>>
>>>>
>>>>
>>>> Thank you very much
>>>>
>>>> Best regards
>>>> Hausiowen Nayu
>>>>
>>>> Ernesto Puerta <epuertat(a)redhat.com> 於 2019年7月2日 週二 下午3:47寫道:
>>>>
>>>>> Hi Hausiowen,
>>>>>
>>>>> The missing rados import might be because you haven't built all Ceph
>>>>> source code (rados is a Ceph component). My recommendation is that you use
>>>>> a building environment. We, Red Hatters working on dashboard, are using the
>>>>> following Docker/Docker-compose environment (
>>>>> https://github.com/rhcs-dashboard/ceph-dev). You have info there on
>>>>> how to install that, test it and run it: it'll give you not only
>>>>> Ceph-dashboard but also Grafana and Prometheus deployed.
>>>>>
>>>>> Kind regards,
>>>>>
>>>>> Ernesto Puerta
>>>>>
>>>>> He / Him / His
>>>>>
>>>>> Senior Software Engineer, Ceph
>>>>>
>>>>> Red Hat <https://www.redhat.com/>
>>>>> <https://www.redhat.com/>
>>>>>
>>>>>
>>>>> On Tue, Jul 2, 2019 at 9:31 AM seribe pasada <clear60enator(a)gmail.com>
>>>>> wrote:
>>>>>
>>>>>>
>>>>>> supplement my previous explanation:
>>>>>> I can run the ./run-tox.sh after chmod +x ./run-tox.sh, but I got the
>>>>>> error of "unable to import 'rados'". I don't know whether I use the
>>>>>> incorrect way or not?
>>>>>> My cognition of the backend structure is show as below(picture), is
>>>>>> anything miss?
>>>>>> I add the code inside dashboard.py for getting query from
>>>>>> frontend(show as picture below), but nothing happens.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Hi Ernesto Puerta,
>>>>>>
>>>>>> Thanks for your great helping hand, and rapid response.
>>>>>>
>>>>>> It is my honor to join the biweekly meeting.
>>>>>> Is OFTC be the chanel for ircs://irc.oftc.net:6697? Ok, I will cc
>>>>>> dev(a)ceph.io later.
>>>>>>
>>>>>>
>>>>>> I have three problem below when I research the code of orchestrator
>>>>>> and backend:
>>>>>>
>>>>>> 1.Can I copy the nautilus's module file(ansible, orchestrator)
>>>>>> inside mimic's mgr file?Can it work?
>>>>>> 2.I found that the function of create_osds(self, drive_group,
>>>>>> all_hosts) in ansible module can deal my problem. But I don't know the way
>>>>>> to use it. Should I add the function to call inside dashboard module.py(I
>>>>>> don't know whether the main function for dashabord is here or not)? Then
>>>>>> using this function to get(or post) the query from js in frontend? If I get
>>>>>> the query then using the function from ansible module.
>>>>>> 3.I try to use ./run-tox.sh for backend but show the Permission
>>>>>> denied error.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Please give me any suggestion and comment, all of your advise is very
>>>>>> valuable.
>>>>>>
>>>>>> Thank you very much
>>>>>>
>>>>>> Best regards
>>>>>> Hausiowen Nayu
>>>>>>
>>>>>> seribe pasada <clear60enator(a)gmail.com> 於 2019年7月1日 週一 下午6:28寫道:
>>>>>>
>>>>>>> Hi Ernesto Puerta,
>>>>>>>
>>>>>>> Thanks for your great helping hand, and rapid response.
>>>>>>>
>>>>>>> It is my honor to join the biweekly meeting.
>>>>>>> Is OFTC be the chanel for ircs://irc.oftc.net:6697? Ok, I will cc
>>>>>>> dev(a)ceph.io later.
>>>>>>>
>>>>>>>
>>>>>>> I have three problem below when I research the code of orchestrator
>>>>>>> and backend:
>>>>>>>
>>>>>>> 1.Can I copy the nautilus's module file(ansible, orchestrator)
>>>>>>> inside mimic's mgr file?Can it work?
>>>>>>> 2.I found that the function of create_osds(self, drive_group,
>>>>>>> all_hosts) in ansible module can deal my problem. But I don't know the way
>>>>>>> to use it. Should I add the function to call inside dashboard module.py(I
>>>>>>> don't know whether the main function for dashabord is here or not)? Then
>>>>>>> using this function to get(or post) the query from js in frontend? If I get
>>>>>>> the query then using the function from ansible module.
>>>>>>> 3.I try to use ./run-tox.sh for backend but show the Permission
>>>>>>> denied error.
>>>>>>>
>>>>>>> Please give me any suggestion and comment, all of your advise is
>>>>>>> very valuable.
>>>>>>>
>>>>>>> Thank you very much
>>>>>>>
>>>>>>> Best regards
>>>>>>> Hausiowen Nayu
>>>>>>>
>>>>>>>
>>>>>>> Ernesto Puerta <epuertat(a)redhat.com> 於 2019年7月1日 週一 下午4:29寫道:
>>>>>>>
>>>>>>>> Hi Hausiowen,
>>>>>>>>
>>>>>>>> We saw you connecting and dropping, so we assumed you had issues.
>>>>>>>> Bluejeans some times requires some tuning before it works properly. You can
>>>>>>>> join our biweekly meeting, you can join OFTC #ceph-dashboard IRC channel as
>>>>>>>> well (this is the preferred method for quick ask&answers). Additionally, we
>>>>>>>> could go back to dev(a)ceph.io. I think other people might benefit
>>>>>>>> from this discussion, if it's held publicly.
>>>>>>>>
>>>>>>>> On your specific questions: I think some support is available for
>>>>>>>> orchestrators in Mimic, but probably not the best. The idea is that you
>>>>>>>> choose your preferred orchestrator tool (kubernets/rook, Ansible, Deepsea,
>>>>>>>> or the in-progress SSH orchestrator) and then you let one of these interact
>>>>>>>> with Ceph by means of a generic command line interface.
>>>>>>>>
>>>>>>>> Kind regards,
>>>>>>>>
>>>>>>>> Ernesto Puerta
>>>>>>>>
>>>>>>>> He / Him / His
>>>>>>>>
>>>>>>>> Senior Software Engineer, Ceph
>>>>>>>>
>>>>>>>> Red Hat <https://www.redhat.com/>
>>>>>>>> <https://www.redhat.com/>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Mon, Jul 1, 2019 at 4:58 AM seribe pasada <
>>>>>>>> clear60enator(a)gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi Ernesto Puerta,
>>>>>>>>>
>>>>>>>>> Thanks for your great helping hand, and rapid response.
>>>>>>>>> And thank you so much for the invitation, I really appreciate it
>>>>>>>>> and it means a great deal. But I can't listen any voice when the meeting.
>>>>>>>>> Maybe I should find the way to deal this problem. May I join you next
>>>>>>>>> biweekly meeting?
>>>>>>>>>
>>>>>>>>> I have research the code of orchestrator_modules, however, the
>>>>>>>>> module seem to support the nautilus only. So I don't know if it support
>>>>>>>>> mimic or not.(or using way to add module to mimic?) In addition, the
>>>>>>>>> feature of adding OSD in orchestrator seem to be necessary with deepsea and
>>>>>>>>> ansible. Should I install the deepsea(only support opensuse) and ansible
>>>>>>>>> additionally?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thank you very much
>>>>>>>>>
>>>>>>>>> Best regards
>>>>>>>>> Hausiowen Nayu
>>>>>>>>>
>>>>>>>>> Ernesto Puerta <epuertat(a)redhat.com> 於 2019年6月28日 週五 下午8:05寫道:
>>>>>>>>>
>>>>>>>>>> Hi Hausiowen,
>>>>>>>>>>
>>>>>>>>>> Aha, so you want to add to the dashboard the capacity for
>>>>>>>>>> creating new OSDs, right?
>>>>>>>>>>
>>>>>>>>>> I don't know if you are familiar to this, but there's an ongoing
>>>>>>>>>> effort to implement this kind of functionality via a neutral/abstract
>>>>>>>>>> orchestrator interface (
>>>>>>>>>> http://docs.ceph.com/docs/master/mgr/orchestrator_modules/ and
>>>>>>>>>> http://docs.ceph.com/docs/master/mgr/orchestrator_cli/) and
>>>>>>>>>> different implementations with 3rd party orchestrators (Rook, Ansible,
>>>>>>>>>> DeepSea, SSH Orchestrator).
>>>>>>>>>>
>>>>>>>>>> However, I don't think there's any effort to bring ceph-deploy
>>>>>>>>>> into that pack. I'm CCing Dashboard (Lenz) and Orchestrator (Sebastian)
>>>>>>>>>> leads. You're welcome to join this existing effort. Today at 15.00 CEST we
>>>>>>>>>> have our Dashboard biweekly sync meeting (
>>>>>>>>>> https://bluejeans.com/633233233), so feel free to drop by,
>>>>>>>>>> introduce yourself and bring in the discussion. We'll be glad to have you
>>>>>>>>>> there.
>>>>>>>>>>
>>>>>>>>>> Kind regards,
>>>>>>>>>>
>>>>>>>>>> Ernesto Puerta
>>>>>>>>>>
>>>>>>>>>> He / Him / His
>>>>>>>>>>
>>>>>>>>>> Senior Software Engineer, Ceph
>>>>>>>>>>
>>>>>>>>>> Red Hat <https://www.redhat.com/>
>>>>>>>>>> <https://www.redhat.com/>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Fri, Jun 28, 2019 at 12:36 PM seribe pasada <
>>>>>>>>>> clear60enator(a)gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Ernesto Puerta,
>>>>>>>>>>>
>>>>>>>>>>> Thanks for your great helping hand, and rapid response.
>>>>>>>>>>> I can add the link to the page successfully with my component
>>>>>>>>>>> and service providing by myself now.
>>>>>>>>>>> It's very appreciated you for your big hand, otherwise, I will
>>>>>>>>>>> spend more time to solve the problem.
>>>>>>>>>>>
>>>>>>>>>>> I want to add button which can execute the shell command " ceph-deploy
>>>>>>>>>>> osd create node11 --data /dev/sda ", so that I can touch
>>>>>>>>>>> button to add osd.
>>>>>>>>>>> So, I plan to add the python code in backend to execute the
>>>>>>>>>>> shell command. Then, I add the button listening with java-scripts in
>>>>>>>>>>> component. Finally, the python as backend get the request of
>>>>>>>>>>> java-scripts code as frontend.
>>>>>>>>>>> The command can be executed when I touch button.
>>>>>>>>>>>
>>>>>>>>>>> Is it the good idea for add osd using button?
>>>>>>>>>>> If I want to add the pyhon code in backend, should I compile
>>>>>>>>>>> with ./run-backend-api-tests.sh?
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Thank you very much
>>>>>>>>>>>
>>>>>>>>>>> Best regards
>>>>>>>>>>> Hausiowen Nayu
>>>>>>>>>>>
>>>>>>>>>>> Ernesto Puerta <epuertat(a)redhat.com> 於 2019年6月28日 週五 下午6:10寫道:
>>>>>>>>>>>
>>>>>>>>>>>> Controller? You mean back-end or front-end?
>>>>>>>>>>>>
>>>>>>>>>>>> You need to do these 2 things:
>>>>>>>>>>>> - Add the link in the navigation component
>>>>>>>>>>>> - Add the component and exposing it in an existing/new module
>>>>>>>>>>>> - Add that component to the router (you may use the main router
>>>>>>>>>>>> module)
>>>>>>>>>>>>
>>>>>>>>>>>> If you want to interact with some back-end (server-side python)
>>>>>>>>>>>> code, you need to use a controller.
>>>>>>>>>>>>
>>>>>>>>>>>> Kind regards,
>>>>>>>>>>>>
>>>>>>>>>>>> Ernesto Puerta
>>>>>>>>>>>>
>>>>>>>>>>>> He / Him / His
>>>>>>>>>>>>
>>>>>>>>>>>> Senior Software Engineer, Ceph
>>>>>>>>>>>>
>>>>>>>>>>>> Red Hat <https://www.redhat.com/>
>>>>>>>>>>>> <https://www.redhat.com/>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On Fri, Jun 28, 2019 at 5:26 AM seribe pasada <
>>>>>>>>>>>> clear60enator(a)gmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Ernesto Puerta,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks for your great helping hand, and rapid response.
>>>>>>>>>>>>> I have tried add the new button in /navigation.component.html
>>>>>>>>>>>>> and service api.It's sucessfully.
>>>>>>>>>>>>> But the page is 404 because I haven't add the page to
>>>>>>>>>>>>> controller. So I guess the controller is in component?
>>>>>>>>>>>>> Do you know how to add page in the router link?
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thank you very much
>>>>>>>>>>>>>
>>>>>>>>>>>>> Best regards
>>>>>>>>>>>>> Hausiowen Nayu
>>>>>>>>>>>>>
>>>>>>>>>>>>> Ernesto Puerta <epuertat(a)redhat.com> 於 2019年6月27日 週四 下午5:53寫道:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> To add a new link to the navigation, you just need to modify
>>>>>>>>>>>>>> the following HTML file:
>>>>>>>>>>>>>> src/pybing/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.html
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> If you have a look at that code, you'll quickly see how
>>>>>>>>>>>>>> top-level, and second-level menu entries are added.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Good luck with it!
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Ernesto Puerta
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> He / Him / His
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Senior Software Engineer, Ceph
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Red Hat <https://www.redhat.com/>
>>>>>>>>>>>>>> <https://www.redhat.com/>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Thu, Jun 27, 2019 at 11:46 AM seribe pasada <
>>>>>>>>>>>>>> clear60enator(a)gmail.com> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi Ernesto Puerta,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks for your great helping hand
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Why I want are three parts:
>>>>>>>>>>>>>>> add the new page in first or secondary layer, which
>>>>>>>>>>>>>>> can show in the origin dashboard
>>>>>>>>>>>>>>> I want to add the link of other website to the page
>>>>>>>>>>>>>>> for dashboard
>>>>>>>>>>>>>>> I can add the button in the page.When I touch the
>>>>>>>>>>>>>>> button, the x.sh under /root can be executed
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> The code I modified is show as below,
>>>>>>>>>>>>>>> The "src file" including all of code, the "modified file"
>>>>>>>>>>>>>>> only for the code I modified
>>>>>>>>>>>>>>> The code can be compiled but the page of addOSD is
>>>>>>>>>>>>>>> wrong(404).
>>>>>>>>>>>>>>> Thank you very much
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Best regards
>>>>>>>>>>>>>>> Hausiowen Nayu
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Ernesto Puerta <epuertat(a)redhat.com> 於 2019年6月26日 週三
>>>>>>>>>>>>>>> 下午6:37寫道:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi Hausiowen,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Glad to have helped you!
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Could I know what are you trying to do? So I can better
>>>>>>>>>>>>>>>> understand this.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Just as a comment: Router Module is just about mapping
>>>>>>>>>>>>>>>> (front-end/browser) URLs to Angular components. It has
>>>>>>>>>>>>>>>> nothing to do
>>>>>>>>>>>>>>>> with the main Navigation Drop-down Menu. That's actually
>>>>>>>>>>>>>>>> hardcoded
>>>>>>>>>>>>>>>> links (URLs) in the HTML template of Navigation Component
>>>>>>>>>>>>>>>> (
>>>>>>>>>>>>>>>> https://epuertat.github.io/components/NavigationComponent.html#template
>>>>>>>>>>>>>>>> ).
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Kind regards,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Ernesto Puerta
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> He / Him / His
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Senior Software Engineer, Ceph
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Red Hat
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Wed, Jun 26, 2019 at 10:00 AM seribe pasada <
>>>>>>>>>>>>>>>> clear60enator(a)gmail.com> wrote:
>>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>> > Hi Ernesto Puerta,
>>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>> > Nice to meet you
>>>>>>>>>>>>>>>> > Thanks for your great helping hand
>>>>>>>>>>>>>>>> > I can compile and build the code in mgr-dashboard then
>>>>>>>>>>>>>>>> show it in web now
>>>>>>>>>>>>>>>> > However, I got the problem when I try to add the new page
>>>>>>>>>>>>>>>> in the button. I studied the structure of dashboard, but I still got error.
>>>>>>>>>>>>>>>> > Maybe I have something mistake when I try to code.
>>>>>>>>>>>>>>>> > I modify the code in src(source code) which including(the
>>>>>>>>>>>>>>>> structure show as picture or link):
>>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>> > first layer router(the
>>>>>>>>>>>>>>>> button:dashboard、cluster、pool...etc): /app/app.module.ts
>>>>>>>>>>>>>>>> > all router: /app/app-routing.module.ts
>>>>>>>>>>>>>>>> > secondar router(the button below first
>>>>>>>>>>>>>>>> layer:cluster->hosts、monitor...etc): /app/ceph/cluster/cluster.module.ts
>>>>>>>>>>>>>>>> > view: /app/ceph/cluster/hosts/hosts.component.ts
>>>>>>>>>>>>>>>> > web foldere(temp+view): /app/ceph/cluster/hosts
>>>>>>>>>>>>>>>> > service router: /app/shared/api/api.module.ts
>>>>>>>>>>>>>>>> > router function: /app/shared/api/host.service.ts
>>>>>>>>>>>>>>>> > router link:
>>>>>>>>>>>>>>>> /app/core/navigation/navigation/navigation.component.html
>>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>> > Can you tell me any I missing?
>>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>> > Thank you very much
>>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>> > Best regards
>>>>>>>>>>>>>>>> > Hausiowen Nayu
>>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>> > link:
>>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>> https://drive.google.com/file/d/1Gyh_4K4iRMkEyxsHkQIgmCeeKBh1mRsw/view
>>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>> > Ernesto Puerta <epuertat(a)redhat.com> 於 2019年6月24日 週一
>>>>>>>>>>>>>>>> 下午11:15寫道:
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> Hi Hausiowen,
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> You can find (mostly) everything a developer may be
>>>>>>>>>>>>>>>> interested in at
>>>>>>>>>>>>>>>> >> Dashboard's HACKING.rst
>>>>>>>>>>>>>>>> >> (
>>>>>>>>>>>>>>>> https://github.com/ceph/ceph/blob/754e08017714543d71835c0deb3853603567f2b4/…
>>>>>>>>>>>>>>>> ,
>>>>>>>>>>>>>>>> >> I'm sending you that commit because Github is not
>>>>>>>>>>>>>>>> rendering that doc
>>>>>>>>>>>>>>>> >> in the master HEAD commit).
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> You can delete all front-end code, and it will still
>>>>>>>>>>>>>>>> work because
>>>>>>>>>>>>>>>> >> Angular/Typescript code is 'transpiled' into Javascript
>>>>>>>>>>>>>>>> code
>>>>>>>>>>>>>>>> >> (frontend/dist subdir), so you don't directly run the
>>>>>>>>>>>>>>>> 'code' version
>>>>>>>>>>>>>>>> >> of the dashboard.
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> So, answering your specific question, you may either:
>>>>>>>>>>>>>>>> >> - Run from build/ subdir: "make
>>>>>>>>>>>>>>>> mgr-dashboard-frontend-build", and
>>>>>>>>>>>>>>>> >> then restart dashboard to reload new front-end ("ceph
>>>>>>>>>>>>>>>> mgr module
>>>>>>>>>>>>>>>> >> disable dashboard && ceph mgr module enable dashboard"),
>>>>>>>>>>>>>>>> >> - Use the development mode front-end Angular provides,
>>>>>>>>>>>>>>>> which
>>>>>>>>>>>>>>>> >> performs incremental auto-builds every time you save a
>>>>>>>>>>>>>>>> change: rename
>>>>>>>>>>>>>>>> >> proxy.conf.json.sample to proxy.conf.json and add the
>>>>>>>>>>>>>>>> backend port and
>>>>>>>>>>>>>>>> >> HTTP/S proto and run "npm run start" (this will run a
>>>>>>>>>>>>>>>> new front-end
>>>>>>>>>>>>>>>> >> server in a different port than the ceph-mgr one).
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> Let us know if that was of help to you!
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> Kind Regards,
>>>>>>>>>>>>>>>> >> Ernesto
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> Ernesto Puerta
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> He / Him / His
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> Senior Software Engineer, Ceph
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> Red Hat
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>>> >> On Mon, Jun 24, 2019 at 4:37 PM seribe pasada <
>>>>>>>>>>>>>>>> clear60enator(a)gmail.com> wrote:
>>>>>>>>>>>>>>>> >> >
>>>>>>>>>>>>>>>> >> > Hi dev,
>>>>>>>>>>>>>>>> >> > Nice to meet you
>>>>>>>>>>>>>>>> >> > I want to modify the code from ceph dashboard
>>>>>>>>>>>>>>>> >> > I try to modify the code from
>>>>>>>>>>>>>>>> /usr/lib/ceph/mgr/dashboard/frontend, but the web do noting even I delete
>>>>>>>>>>>>>>>> all frontend folder.
>>>>>>>>>>>>>>>> >> > I guess the frontend should built to the
>>>>>>>>>>>>>>>> /frontend/dist folder by angular or nodejs; however, both of the methods is
>>>>>>>>>>>>>>>> failed.
>>>>>>>>>>>>>>>> >> > Can you tell me how to build or run the frontend code
>>>>>>>>>>>>>>>> I modify to the web?
>>>>>>>>>>>>>>>> >> >
>>>>>>>>>>>>>>>> >> > Thank you very much
>>>>>>>>>>>>>>>> >> >
>>>>>>>>>>>>>>>> >> > Best regards
>>>>>>>>>>>>>>>> >> > Hausiowen Nayu
>>>>>>>>>>>>>>>> >> > _______________________________________________
>>>>>>>>>>>>>>>> >> > Dev mailing list -- dev(a)ceph.io
>>>>>>>>>>>>>>>> >> > To unsubscribe send an email to dev-leave(a)ceph.io
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
I recently upgraded from Luminous to Mimic (13.2.6) and now I find
that I have a single pg that is stale and cannot be repaired or
cleaned up. I had to remove several OSDs due to some issues after the
upgrade and now I have this one pg that is in a state that I cannot
get rid of.
Any hints on how to fix this?
$ ceph pg dump_stuck
PG_STAT STATE UP UP_PRIMARY ACTING
ACTING_PRIMARY
54.163 stale+active+undersized+degraded [94,63] 94 [94,63]
94
$ ceph pg 54.163 query
Error ENOENT: i don't have pgid 54.163
Both osd.94 and osd.63 are OK, pool 54 (cephfs_metadata) is a 3-copy
pool, so it looks like the 3rd copy of the pg is missing. The logs
for osd.94 and osd.63 show this when I grep for the missing pg:
2019-07-02 14:14:51.632 7fb796f54700 1 osd.63 pg_epoch: 173782
pg[54.163( v 173599'29032 (165339'27516,173599'29032]
local-lis/les=173715/173716 n=1213 ec=56712/56712 lis/c 173715/173657
les/c/f 173716/173658/0 173782/173782/173770) [94,63] r=1 lpr=173782
pi=[173657,173782)/1 crt=173599'29032 lcod 0'0 unknown NOTIFY mbc={}]
state<Start>: transitioning to Stray
thanks,
Wyllys Ingersoll
Hi everyone,
Our next Ceph Developer Monthly will be next week,
Wed Jul 10 at 9PM ET, or
Thu Jul 11 at 0100 UTC
The agenda:
https://tracker.ceph.com/projects/ceph/wiki/CDM_10-JUL-2019
The current topics are all RADOS related:
- Network ping monitoring: better monitoring and reporting of latencies
between OSDs.
- Muting health warnings: adding the ability to mute health alerts for
some period of time via CLI or GUI.
- Slow request diagnostics: improving our overall behavior (reporting,
diagnosability, etc) when things aren't going quite right (slow/busy disk,
CPU bottleneck, slow requests, OMAP slow requests, etc)
If you have other topics you'd like to discuss, reply to this email or add
them to the wiki agenda (linked above).
Thanks!
sage
FYI -- Odd notice about my response being held when responding to
Yuri's validation status email: "Message has more than 10 recipients"
---------- Forwarded message ---------
From: <dev-bounces(a)ceph.io>
Date: Tue, Jul 2, 2019 at 12:45 PM
Subject: Your message to dev(a)ceph.io awaits moderator approval
To: <jdillama(a)redhat.com>
Your mail to 'dev(a)ceph.io' with the subject
Re: 14.2.2 QE Nautilus validation status
Is being held until the list moderator can review it for approval.
The message is being held because:
Message has more than 10 recipients
Either the message will get posted to the list, or you will receive
notification of the moderator's decision.
--
Jason
All,
especially in the Ceph Orchestrator world, we're facing an issue where
we don't have a place for for Python code that can be imported by the
MGR and by tools that deploy Ceph.
Having a Library for common Python code would also provide a way to ease
some other Python related problems (also orchestrator independent):
1. There is duplicated code in the cython bindings. Especially the
Exceptions are duplicated for each binding.
2. There is no good way to share Python code between different tools
written in Pyhton
3. There is no way to share common code, like e.g. common data
structures between the different layers of the Orchestrator stacks.
4. There is no statically type-checkable Python API for the (mon)
command API.
5. The local Ceph version number is hard coded into the ceph cli binary
Now, the idea is to build a new Python package that is supposed to be
importable by everyone.
From a user's POV, this would look something like
>
> from ceph.mon_command_api import MonCommandApi
> from ceph.deployment_utils import DriveGroupSpec
> from ceph.exceptions import Error
>
> MonCommandApi(...).osd_pool_create(pool='my_pool', ...)
>
> try:
> ...
> except OSError:
> ...
What would be the scope of this library? Basically everything where
there is a real benefit for having it included, like sharing common code
between things. From the orchestrator, this could include common
deployment recipes. Or recipes used by the SSH orchestrator.
Some open questions are:
What about code that right now lives in the dashboard, like
pybind/mgr/dashboard.controllers.rbd.Rbd#_rbd_disk_usage
for calculating the RBD disk usage?
Where does it live in the ceph git? /src/python-common/ ?
How can we package it?
Python 2?
Thanks,
Sebastian
--
--
SUSE Linux GmbH, Maxfeldstrasse 5, 90409 Nuernberg, Germany
GF: Felix Imendörffer, Mary Higgins, Sri Rasiah, HRB 21284 (AG Nürnberg)