Jump to: navigation, search

Talk:Callisto Coordinated Update Sites

Revision as of 21:49, 11 February 2006 by David williams (Talk | contribs) ((re)organized sections and added comments)

Talk Page started by Kim Moir (platform-releng) :-)

I've done a bit of editing to try and keep this page organized, and show what's been resolved and what still needs some active work. If anyone ever see's I've edited too much, please say so, as I'm sure it was unintentional. Eventually we may want to move "resolved and stale" issue to some separate history page and some of the "news" topics may deserve a page of their own, eventually. And ... by all means ... all committers to Callisto should feel free to contribute to these pages by organizing the content, or provide links out to other pages, etc. The end goal is to end up with a great "main" page that everyone finds accurate and a useful reference.

-- David williams 21:49, 11 February 2006 (EST)

Page talks tips

I believe the little "+" symbol next to the edit button at top should be used for these talks. --Denis Roy 16:50, 6 February 2006 (EST)

Which will add a new level 2 section at bottom of page.

Responses to page talk sections

I think it also seems to work fairly well to add a level 3 section to "respond to" a level 2 section. I do not know if there's an easy short cut for that, I've just been doing it "manually". (with 3 equal sign's (title) 3 equal signs)

-- David williams 21:49, 11 February 2006 (EST)

author date and time

And, if you don't know if yet, 4 tildes in a row automatically gets converted to your name, and the current date and time, for easy marking of who and when. I guess the bracket(initials-username)end-bracket just shows how out of date we are with this fancy new Wiki stuff :)

-- David williams 21:49, 11 February 2006 (EST)

URL's for Callisto updates

[kmoir] There is a problem with the url http://update.eclipse.org/updates/callisto/

Currently, the platform team stores all its updates in this directory


and subdirectories such as these

http://update.eclipse.org/updates/3.0 http://update.eclipse.org/updates/3.1

So I don't know that this is the best url for Callisto


given that

  • we already have platform content in that directory
  • we can't change the Apache alias for platform because this has been hardcoded in our feature.xmls
  • the unix permissions on the directory mean that the platform team would need to retain ownership in order to continue update the content in the existing update sites.
  • [dmw: agreed, we should have 'callisto' first in the URL, and keep it "parallel" other Eclipse projects]

    [denis: I can't host this on update.eclipse.org/callisto. How about download.eclipse.org/callisto?]

    [nickb] How about: http://update.eclipse.org/updates/3.2/callisto.xml (in the same folder as site.xml) ? [dmw] I think we're leaning toward http://download.eclipse.org/callisto, but wanted to comment on the comment ... I think we should avoid having version numbers in (any) directory ... isn't the long term goal to have a constant update site for all time, and just keep putting new plugins and features in there, as needed, so to speak? ... and, hopefully, there may start to be more and more that don't actually change, say from 3.2 to 3.3?]

    [kmoir]Until the code to resolve this bug is implemented, we can't ensure that we can just reuse the same update site from release to release. https://bugs.eclipse.org/bugs/show_bug.cgi?id=123162

    Resolved: URL's for Callisto updates

    These issues have been resolved as best they can, and the main page updated to reflect the update URL's for Callisto will be http://download.eclipse.org/callisto/

    -- David williams 21:49, 11 February 2006 (EST)

    How all-or-nothing and few-or-many-choices should Callisto be

    [kmoir] Providing Callisto as a single download comprising all 10 projects provides better exposure to the newer projects. By the same token, it also forces people to download stuff that they may not necessarily want or ever use, thus significantly increasing the strain on the distribution infrastructure. It is also rather overwhelming for a new eclipse user. My point is, perhaps there is a better way to educate users and provide choice while simultaneously exposing the full breadth of functionality available with Callisto.

    [dmw: yep, this is the question to be answered empirically and via community feedback ... but if we get one packaging working ... a few others should be easy --- though, I'd never want to get to the point of a Callisto user having more than, say, 4 or 5 choices ... those users that want more fine grained control than that will have to use project update URLs]

    [nickb] I agree that making people download EVERYTHING is both overkill and will overtax the infrastructure. However, as David points out, "enabling" projects like EMF and GEF are required for the more newb-friendly projects, so could we have a set of screenshots just showing people how to use UM and the various requirements they need to check off in order to get the projects they want? I like what WTP has done for their UM site, for example.

    Tool to track downloads

    By the way, I'm working on a tool to track download stats for EMF (and later, other projects who want to implement it), which combines

    • a PHP script which runs SQL queries at the eclipse.org download stats database,
    • a set of 3 cronjobs (actually, one shell script w/ three different options) for nightly/weekly/monthly querying using that interface, and
    • a web UI to display those results for trending and overall results (eg., combining monthly data across a year or weekly data across a quarter; or comparing 4 consecutive weeks to see if downloads increase or decrease over time)

    The purpose for us is:

    If you feel these tools/stats would be of value to other projects, I'd be happy to volunteer the code (and time to help set it up) for any other Callisto projects you'd like to track. See /cvsroot/org.eclipse/www/emf/downloads/

    Responses: Tool to track downloads

    Nick, thanks. First, your tool does sound very interesting ... I personally won't have time to investigate it much for a while, but I'd think we'd want these sorts of stats for all Eclipse projects, especially those in Callisto!

    Sizes involved with Callisto

    Since several have voiced concerned over size of Callisto, I guess we should start to estimate its size.

    Here's my off hand estimates of "runtime" sizes of several components (in MegaBytes). These are mostly guesses at this point (but a few I'm "updated" recently), but if enough people provide estimate, we'll get a little better idea of what tradeoffs are.

    [Callisto meisters: feel free to update your portions of table to be accurate ... using current milestones, or previous release milestones as estimates. Any rough estimate will do.]

    [nickb] You can get numbers for your most recent builds like this:

    • ssh username@dev.eclipse.org
    • cd /home/data/httpd/download.eclipse.org/tools/emf/downloads/drops/2.2.0/I200602020000
    • find . -name "*.zip" -exec du -sh {} \;


    If we literally included each (sub) project as a choice, that would be 15 choices ... which I think is too many for what I've thought Callisto was for. Perhaps someone could propose some concrete "groupings" that would satisfy majority of users (though, I'm pessimistic if we could reach much agreement?)

    If we go that route, though, I don't think we would need to do anything, except maybe to get the platform plugin to provide all 10 "discovery sites"?

    Also, maybe our friendly webmaster could comment on if these "increases in size" are of the size to be of concern .... such as is 75 Megs, say, that much different than 150? Is 150 that much different that 300? (I know "twice as big" sounds like a lot ... but .. its not like 10 times as much). And with our improved "nearest mirror" support, maybe it wouldn't matter?).

    [denis: also consider that the bigger it is, the longer it will take to reach all our mirrors. The good news is that Mike okay'd an extra 200Mb (!!) of bandwidth for (but not limited to) Callisto, in addition to and separate of the 100Mb for eclipse.org, so we'll be in good shape for actual distribution.]

    Project Runtime Size SDK Size
    Business Intelligence and Reporting Tools (BIRT) 3 ?
    C/C++ IDE (CDT) 10 ?
    Data Tools Platform (DTP) 6 ?
    Eclipse Modeling Framework (EMF, SDO, XSD) EMF/SDO: 3.4, XSD: 1 EMF/SDO/XSD: 23
    Eclipse Project (Platform only) 15 ?
    Eclipse Project (PDE, JDT) 60 ?
    Graphical Editing Framework (GEF) 3 ?
    Graphical Modeling Framework (GMF) 6 ?
    Test and Performance Tools Platform (TPTP) 10 ?
    Visual Editor (VE, JEM) 5 ?
    Web Tools Platform (WTP, WST, JST) 25 45
    Totals 150 300

    Concurrent Builds & Releases

    Release Train Cascade / RSS Notification & Response

    [nickb] There's been a fair amount of discussion about getting the Callisto projects to align in terms of their releases (before the subject of UM was broached). Should this be a page by itself, rather than a footnote here, by all means please do. The link above shows what's been done so far in terms of building a build cascade automation scheme, along with some comments from the community. Please post comments about this plan into that bug so that I can integrate your requests into it, in order to make this solution more portable across all Callisto projects.

    Responses to: Concurrent Builds & Releases

    Yes, I'd agree the information in the above referenced bug report would make a good a Wiki page that spelled out the "how to" information ... step by step directions, links to example scripts, etc. I myself am not too concerned about cascaded builds, per se (we do "continuous builds", which would sort of lead to a combinatorial explosion if we and everyone followed it literally. Also, I haven't checked recently, but that discussion did not seem to address "cascading updates" ... which would be nice for developers (and by this I mean notifications of some new "weekly" update being available. That way, developers could perhaps automatically update their targets, with minimal effort.

    Just agreeing (I'm not volunteering :).

    -- David Williams 19:57, 11 February 2006 (EST)

    Cross project requirements - best practices

    [kmoir] On the same note, I couldn't find a document that gathered best practices for projects participating in Callisto

    For instance, from the platform

    http://www.eclipse.org/equinox/documents/plugin-versioning.html Using qualifiers
    http://www.eclipse.org/eclipse/platform-core/documents/3.1/run_from_jars.html Using jarred plugins and features
    signing jars ....etc.

    Responses to: Cross project requirements - best practices

    Thanks Kim, I've adding the plugins-as-jars link to the main page's Callisto_Coordinated_Update_Sites#Related_Links_for_Further_Enjoyable_Reading_and_Reference
    Thanks for pointing it out. (In general, all Callisto Committers should free to add references or annotations to Callisto_Coordinated_Update_Sites#Related_Links_for_Further_Enjoyable_Reading_and_Reference)

    The versioning document was already linked there.

    I didn't actually see much info in the jars document about "how to" sign plugins-as-jars. Has that effort or information moved further along?

    And, by all means, I'm sure the community would use any "best practices" Wiki pages. If real general, beyond Callisto, I suggest you add pointers to them on Development_Conventions_and_Guidelines. For example, there you will find a link to a kind-of-out-of-date User_Interface_Guidelines which we in Callisto should also pay attention to.

    -- David Williams 20:13, 11 February 2006 (EST)