<html><head></head><body>Braddock said that we could reduce the number of levels in a given deployment and then find the parameter in IIAB/OSM that controls maximum zoom. How many levels do you plan to generate? I think there are 12 or 13 currently out of a max of 15, but I don't have my notes here.<br><br><div id="1330123162495-sig-id">Sent from my BlackBerry® PlayBook™<br>www.blackberry.com</div><br><hr><div><strong>From:</strong> "Anish Mangal" <anishmg@umich.edu><br><strong>To:</strong> "xsce-devel" <xsce-devel@googlegroups.com><br><strong>CC:</strong> "Server-Devel@Lists. Laptop. Org" <server-devel@lists.laptop.org>, "braddock@gmail.com" <braddock@gmail.com><br><strong>Sent:</strong> 14 May, 2015 1:47 AM<br><strong>Subject:</strong> Re: [XSCE] Steps involved in generating OSM maps for IIAB<br></div><br><div dir="ltr"><div><div><div>From my limited experience, all these things are possible but since the process is not automated, it takes some effort to make these customizations. I think our cause would be better served by..<br><br></div>1. Generating tiles for the planet at two zoom levels. <br></div>2. Engaging the OSM community in a more formal manner post that. <br><br></div>In my limited interaction with the OSM community they were quite supportive and active with their help :-)<br><br><div class="gmail_extra">--<br></div><div class="gmail_extra">Anish<br><br></div><div class="gmail_extra"><div class="gmail_quote">On Thu, May 14, 2015 at 11:11 AM, Tim Moody <span dir="ltr"><<a href="mailto:tim@timmoody.com" target="_blank">tim@timmoody.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div><div dir="ltr">I assume that with new geo data the index will also need to be regenerated. Whoosh 2.6 is the last version compatible with the current index. Hopefully the new index will support later versions of Whoosh.<div><br></div><div>My other request is that we make sure we can accommodate different levels of zoom for platforms with different amounts of storage when tiles are generated (vertical partitioning). I also wonder if different levels of zoom for different geographical areas is possible. A school's home country might have more zoom than other places I study in geography class but don't visit. (horizontal partitioning). I know that OSM provides subsets of data for different regions.<br><br><div><hr>Date: Wed, 13 May 2015 22:26:05 +0530<span class=""><br>Subject: Re: [XSCE] Steps involved in generating OSM maps for IIAB<br></span>From: <a href="mailto:anishmg@umich.edu" target="_blank">anishmg@umich.edu</a><br>To: <a href="mailto:xsce-devel@googlegroups.com" target="_blank">xsce-devel@googlegroups.com</a><br>CC: <a href="mailto:server-devel@lists.laptop.org" target="_blank">server-devel@lists.laptop.org</a><div><div class="h5"><br><br><div dir="ltr"><div><div><div><div>Hi Adam,<br><br></div>So I have gotten past step one of the map generation process which is importing planet data in a postgres db (which took a few tries due to a lack of understanding of the system setup). Next, I need to generate the tiles. The process will probably take a couple of weeks and it may be a few more days when I can get around to doing this (but should be doable without problems)<br><br></div>Many thanks to Braddock for helping out with this and making it possible. :-)<br><br></div>Cheers,<br></div>Anish<br><br><div><br><div>On Wed, May 13, 2015 at 4:16 PM, Adam Holt <span dir="ltr"><<a href="mailto:holt@laptop.org" target="_blank">holt@laptop.org</a>></span> wrote:<br><blockquote style="border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><span>On Fri, Apr 24, 2015 at 12:19 PM, Anish Mangal <span dir="ltr"><<a href="mailto:anishmg@umich.edu" target="_blank">anishmg@umich.edu</a>></span> wrote:<br></span><div><div><span><blockquote style="border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><div>Hi Braddock,<br></div><br></div>Am willing to give this a shot. The map data on IIAB could do with an update. Let me know how/where I should access the machine.<br></div></div></blockquote><div><br></div></span><div>Anish,<br><br></div><div><i>How can others assist you here?</i><br><br></div><div>PS Tim Moody miraculously fixed OpenStreetMap city/town search on a Rwanda-bound IIAB/XSCE server on CentOS "7.1", by downgrading Whoosh from 2.7 to 2.6 overnight, just last night!<br></div><div> <br></div><div><br></div><blockquote style="border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><div>Will share my public ssh key with you separately.<br><br></div><div>Best,<br></div><div>Anish<br><br></div></div></div><div><div><div><div><div><br><div>On Fri, Apr 24, 2015 at 9:12 PM, Braddock Gaskill <span dir="ltr"><<a href="mailto:braddock@gmail.com" target="_blank">braddock@gmail.com</a>></span> wrote:<br><blockquote style="border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Tim,<div>The first step of the OSM processing is to import it into a huge PostGreSQL database, and is what is used in tile rendering. That database has to reside on an SSD or the later rendering of tiles is too slow. So no, you can't really reduce the SSD storage requirement.</div><div><br></div><div>I have a machine available that I built for this task if anyone wants to use it remotely.</div><span><font color="#888888"><div><br></div><div>-braddock</div></font></span></div><div><div><div><br><div>On Thu, Apr 23, 2015 at 11:13 PM, Tim Moody <span dir="ltr"><<a href="mailto:tim@timmoody.com" target="_blank">tim@timmoody.com</a>></span> wrote:<br><blockquote style="border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>Any way to do the calcs in smaller chunks to cut down on the storage requirements, or even get to ramdisk?<br><br><div>Sent from my BlackBerry® PlayBook™<br><a href="http://www.blackberry.com" target="_blank">www.blackberry.com</a></div><br><hr><div><b>From:</b> "Braddock Gaskill" <<a href="mailto:braddock@gmail.com" target="_blank">braddock@gmail.com</a>><br><b>To:</b> "<a href="mailto:xsce-devel@googlegroups.com" target="_blank">xsce-devel@googlegroups.com</a>" <<a href="mailto:xsce-devel@googlegroups.com" target="_blank">xsce-devel@googlegroups.com</a>>, "Braddock Gaskill" <<a href="mailto:braddock@braddock.com" target="_blank">braddock@braddock.com</a>><br><b>Sent:</b> 24 April, 2015 1:45 AM<br><b>Subject:</b> Re: [XSCE] Steps involved in generating OSM maps for IIAB<br></div><div><div><br><div dir="ltr"><div>IIAB Open Street Map generation...</div><div><br></div>Note:<div>-generating the OSM tiles requires a machine with at least a 500GB SSD (conventional HD is too slow) and 16 GB RAM, preferably with 4 or 8 cores. </div><div><br></div><div>-It will take about a week of processing.</div><div><br></div><div>-It was last done in 2012 on an Ubuntu 12.04 machine, and the OSM tools have probably changed a lot</div><div><br></div><div>-I have a machine that should do the job if you want to do it remotely</div><div><br></div><div>-Documentation on the procedure is available in the IIAB "Maintainers Guide"</div><div><a href="https://github.com/braddockcg/internet-in-a-box/blob/master/doc/Maintainers_Guide.txt" target="_blank">https://github.com/braddockcg/internet-in-a-box/blob/master/doc/Maintainers_Guide.txt</a><br></div><div><br></div><div><br></div><div>-Further raw notes on what I did are in:</div><div><a href="https://github.com/braddockcg/internet-in-a-box/blob/master/doc/NOTES.txt" target="_blank">https://github.com/braddockcg/internet-in-a-box/blob/master/doc/NOTES.txt</a></div><div>See both sections:<table style="border-collapse:collapse;border-spacing:0px;color:rgb(51,51,51);font-family:Helvetica,arial,nimbussansl,liberationsans,freesans,clean,sans-serif,"Segoe UI Emoji","Segoe UI Symbol";font-size:13px;line-height:20.2222px"><tbody><tr></tr><tr><td style="padding:0px 10px;vertical-align:top;overflow:visible;word-wrap:normal"><font face="Consolas, Liberation Mono, Menlo, Courier, monospace"><span style="font-size:12px;white-space:pre-wrap">"OpenStreetMap - 8/23/12"
and further down</span></font><br><table style="border-collapse:collapse;border-spacing:0px;font-family:Helvetica,arial,nimbussansl,liberationsans,freesans,clean,sans-serif,"Segoe UI Emoji","Segoe UI Symbol";font-size:13px;line-height:20.2222px;white-space:normal"><tbody><tr></tr><tr><td style="padding:0px 10px;vertical-align:top;font-family:Consolas,"Liberation Mono",Menlo,Courier,monospace;font-size:12px;white-space:pre-wrap;overflow:visible;word-wrap:normal">OSM Planet Import</td></tr><tr><td style="padding:0px 10px;width:50px;min-width:50px;white-space:nowrap;font-family:Consolas,"Liberation Mono",Menlo,Courier,monospace;font-size:12px;line-height:18px;color:rgba(0,0,0,0.298);vertical-align:top;text-align:right;border-style:solid;border-color:rgb(238,238,238);border-width:0px 1px 0px 0px"></td></tr></tbody></table><br>-If you are lucky, the OSM project documentation and tools have improved since 2012. There was a LOT of trial and error back then.<br><br>-braddock</td></tr></tbody></table><br><div><br></div><div><br></div></div></div><div><br><div>On Thu, Apr 23, 2015 at 10:24 PM, Anish Mangal <span dir="ltr"><<a href="mailto:anishmg@umich.edu" target="_blank">anishmg@umich.edu</a>></span> wrote:<br><blockquote style="border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Yes. A listing of steps involved would be useful.<div><div><br><div><br><div>On Fri, Apr 24, 2015 at 10:53 AM, Tony Anderson <span dir="ltr"><<a href="mailto:tony_anderson@usa.net" target="_blank">tony_anderson@usa.net</a>></span> wrote:<br><blockquote style="border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi,<br>
<br>
My recollection is that was done by Braddock. It involved rendering the tiles downloaded from OSM.<span><font color="#888888"><br>
<br>
Tony</font></span><div><div><br>
<br>
On 04/24/2015 06:23 AM, Anish Mangal wrote:<br>
<blockquote style="border-left:1px solid rgb(204,204,204);padding-left:1ex">
Hi,<br>
<br>
Are the steps to generate OSM data for use with IIAB documented somewhere. Am willing to give it a try to download the map-data and generate the required images/files.<br>
<br>
Best,<br>
Anish<br>
<br>
</blockquote>
<br>
</div></div></blockquote></div><br><br clear="all"><br><div dir="ltr"><div><br></div></div>
</div></div></div></div>
</blockquote></div><br></div>
</div></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br><br clear="all"><br></div></div>--<br clear="all"><br></div></div><span><font color="#888888">-- <br><div><div dir="ltr">Unsung Heroes of OLPC, interviewed live @ <a href="http://unleashkids.org" target="_blank">http://unleashkids.org</a> !</div></div>
</font></span></div></div>
</blockquote></div></div></div>
</blockquote></div><br><br clear="all"><br>-- <br><div><div dir="ltr"><br><div><br></div></div></div>
</div></div></div></div></div></div> </div></div>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature"><div dir="ltr"><br></div></div>
</div></div>
</body></html>