<div dir="ltr"><div>Thanks Mojca for your prompt reply.</div><div>

<span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">1) description, version,maintainer, homepage, variants, dependencies,</span><span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">dependent ports,etc</span> <br></div><div>So for information of each port, my website has to scrape data from such pages :</div><div> </div><a href="https://github.com/macports/macports-ports/blob/master/python/py-amqplib/Portfile">https://github.com/macports/macports-ports/blob/master/python/py-amqplib/Portfile</a><br><div><br></div><div>is this correct?</div><div><br></div><div>

<span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">2) Build Summary: </span></div><div><span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">Would scraping buildbot history pose a problem?</span></div><div><span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">and " <span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><span> </span>modify the </span><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">buildbot setup to submit data to the server.</span> "</span></div><div><span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">isn't it aldready submitting data to the server?<br></span></div><div><span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">if not how is the buildbot history currently generated?</span></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On 25 March 2018 at 04:01, Mojca Miklavec <span dir="ltr"><<a href="mailto:mojca@macports.org" target="_blank">mojca@macports.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">On 24 March 2018 at 22:50, Vishnu wrote:<br>
> Well that's really nice.<br>
> I'll be emailing you the proposal very soon.<br>
> I would really like to work on creating dynamic websites for each port with<br>
> one framework.<br>
> I think that is what you are also working on currently.Or is it something<br>
> else?(Umesh Sir)<br>
><br>
> I would like to go with option B.<br>
><br>
> What i understand is .Basically, i will be creating a dynamic<br>
> website/framework (use some scripting language) to generate/gather all the<br>
> following information for any port that is requested.<br>
><br>
><br>
> - all the information about the port (description, version,<br>
> maintainer, homepage, variants, dependencies, dependent ports, ...)<br>
> - build summary (as scraped from buildbot history): which version was<br>
> built at what time on which os, successful or not, ...<br>
>   - including whether or not a binary package exists<br>
> - installation statistics (from users who opted in and send a json<br>
> file every now and then) with some graphs, similar to the stats page<br>
> above<br>
> - results of "livecheck": whether there's a newer version of the port<br>
> available<br>
> - short git log with links to the last few changes to the Portfile<br>
> - links to trac tickets for that port<br>
><br>
> <a href="https://trac.macports.org/query?0_port=python27&0_port_mode=%7E&0_status=%21closed" rel="noreferrer" target="_blank">https://trac.macports.org/<wbr>query?0_port=python27&0_port_<wbr>mode=%7E&0_status=%21closed</a><br>
> - (maybe links to pull requests for that port)<br>
><br>
> Is my understanding of the project correct?<br>
><br>
> Now to generate:<br>
> 1) description, version,maintainer, homepage, variants, dependencies,<br>
> dependent ports,etc:<br>
> I will need to update this script<br>
> <a href="https://github.com/g5pw/macports-port-tree" rel="noreferrer" target="_blank">https://github.com/g5pw/<wbr>macports-port-tree</a> made by Aljaz for the remaining<br>
> missing information.because not all information is produced by this tool.<br>
<br>
</div></div>This source of information PortIndex which can be generated from<br>
<a href="https://github.com/macports/macports-ports" rel="noreferrer" target="_blank">https://github.com/macports/<wbr>macports-ports</a> (that's part of MacPorts<br>
installation process, it should be possible to get it under linux as<br>
well, but I didn't try, we also mirror it).<br>
<br>
PortIndex is some data structure in Tcl which can be converted into<br>
JSON with an existing script postindex2json, but ideally the Tcl<br>
script should be fixed to generate data in a better format.<br>
This data would then need to be imported at the beginning, but the<br>
application should keep accepting updates about new or deleted ports.<br>
<span class=""><br>
> 2) Build Summary: This can be generated by scraping through buildbot<br>
> history.<br>
<br>
</span>For historic data. For the future it would be better to modify the<br>
buildbot setup to submit data to the server.<br>
<span class=""><br>
> 3) Installation Statistics: Take help from Stats web app(Gsoc 2011 project)<br>
><br>
> 4)Results of livecheck: I am not sure how to get that. i'll be needing help<br>
> to how to get this.<br>
<br>
</span>Sample output from the package manager:<br>
<br>
> port -v livecheck *<br>
Bear seems to be up to date<br>
CImg seems to have been updated (port version: 1.7.9, new version: 2.2.1)<br>
CoreOSMakefiles seems to be up to date<br>
Error: cannot check if Djinn was updated (regex didn't match)<br>
Drizzle seems to have been updated (port version: 30, new version: 31)<br>
FlowUI seems to be up to date<br>
GASNet seems to have been updated (port version: 1.26.3, new version: 1.30.0)<br>
GitX seems to be up to date<br>
HaXml seems to have been updated (port version: 1.20.2, new version: 1.23.3)<br>
Error: livecheck failed for LibVNCServer: extracted version '0.4' is<br>
older than livecheck.version '0.9.9'<br>
LucenePlusPlus seems to be up to date<br>
Error: livecheck failed for MongoObjCDriver: extracted version 'test2'<br>
is older than livecheck.version '1.0.6'<br>
Error: cannot check if PlasmaShop was updated (regex didn't match)<br>
ResIL seems to have been updated (port version: 1.7.9, new version: 1.8.3)<br>
Error: cannot check if SilverCity was updated (regex didn't match)<br>
SourceKitten seems to have been updated (port version: 0.17.6, new<br>
version: 0.19.1)<br>
Error: cannot check if VillainousStyle was updated (regex didn't match)<br>
aap seems to be up to date<br>
<div class="HOEnZb"><div class="h5"><br>
> 5) Link to track tickets : Can be done using scripting,html.<br>
> 6)Pull request : Can be done.<br>
<br>
</div></div><span class="HOEnZb"><font color="#888888">Mojca<br>
</font></span></blockquote></div><br></div>