6000 x 3000 spherical maps from Anywhere in the ( watermarked non-commercial use ) Google Street Vie

mCasual

>>>>>>>> https://sites.google.com/site/mcasualsdazscripts5/anywhereintheworld

This helps you convert the google street-view panoramas into images
which you can then apply to environment spheres
( it even works on plain Daz Studio Spheres )

The Google Street images are watermaked and most probably not usable for commercial purposes

================================
NEW VERSION HTML5 Standalone !
================================
Your browser needs to support HTML5 like Google Chrome on Windows does

Get mcjMosaicHTML5.html from the download/manual page
1 - copy&paste; your google-maps-streetview url in the textbox
2 - click the submit button

The panorama-mosaic will build up when it’s complete your browser is sent to the location of the panorama as a jpeg image

3 - Use your browser's "Save as", "Save image As" or "Copy"

================================
The ( 1 day ) old version
================================
a web page ( javascript ) to obtain the 91 Google Streetview image tiles
and a batch and imagemagick to do the montage
the result, a 6000 x 3000 pixels spherical/equirectangular image
which can then be applied to most environment spheres
including the plain Jane Daz-Studio primitive spheres

================================
The ( last night ) old version, for Linux
================================
this time the web page creates a batch file
which will use Linux's CURL utility to download the image tiles

================================
there's also the
New Section - The Esmwy Python way for MACs and Linux
which uses Python scripts to download and assemble the mosaic on Macs and Linux
================================

================================
Free SkyBall Prop for Poser, Daz Studio and Carrara i guess
================================
I posted a SkySphere prop which is compatible with those panorama images
http://www.daz3d.com/forums/discussion/57412/
https://sites.google.com/site/mcasualsdazscripts5/mcjskysphere

WendyLuvsCatz

this is so cool

mCasual

just now i posted a SkySphere prop which is compatible with those panorama images

http://www.daz3d.com/forums/discussion/57412/
https://sites.google.com/site/mcasualsdazscripts5/mcjskysphere

mjc1016

I'm getting some odd behavior...like no ability to save the page.

It wants to save a copy of the script with the url I want from Google Maps in it, instead of a complete page with all the pics.

mCasual

mjc1016 said:

I'm getting some odd behavior...like no ability to save the page.

It wants to save a copy of the script with the url I want from Google Maps in it, instead of a complete page with all the pics.

in google chrome, once the mosaic of picture is displayed

i click the google "Save Page As" menu

and there's a "Webpage Complete" option

which saves the whole thing including CBK images to disk

maybe tomorrow i'll make a daz script version of it
the javascript just extirpates the "pano-id" from the long GoogleMaps URL
then it creates an html page with a 13x7 table of images
http://cbk0.google.com/cbk?output=tile&panoid=DL1txH4VkTWOoChA6RYMeQ&zoom=4&x=1&y=3

every few feet it takes photos that cover 360 degrees horizontally and almost 180 degrees vertically
then they replace the missing ground using blurry patch from neighboring photos

images from bicycle-mounted cameras and backpack-mounted-cameras are better in some ways because
your Daz Studio camera is only slightly lower than that so there's less distorsion
but you lose image sharpness of the ground

WendyLuvsCatz

I just rightclicked save image myself.
The google camera is an almost 360 spherical one I guess too, well getting there as it needs to point cloud map out the car its under :lol:
in effect street view is a series of VR images along the roads.

mjc1016

Casual said:

mjc1016 said:

I'm getting some odd behavior...like no ability to save the page.

It wants to save a copy of the script with the url I want from Google Maps in it, instead of a complete page with all the pics.

in google chrome, once the mosaic of picture is displayed

i click the google "Save Page As" menu

and there's a "Webpage Complete" option

which saves the whole thing including CBK images to disk

Yeah...for some reason, I have no options.

I either get 1 image (one of the small 'tiles) or it saves mcjMosaic-3.html with no options for 'complete'. The number will increment, until I clear the history, then it will start over again.

I finally got one to save, by opening the Chrome saved mcjMosaic-3.html in SeaMonkey, hitting Submit, again...and then in SeaMonkey it allowed me to save the Web page, complete...

Except, it's saving the tiles in a different order, so the assembly script is not putting them together correctly...well, it is, but the order they are in is not making a nice image. And, no, I haven't determined a pattern that Seamonkey is saving the tiles in...it seems somewhat random.

This is a snippet of the assembled output...

mCasual

mjc1016 said:

saving images to disk

maybe maybe maybe place the mcjMosaic.html elsewhere on your disk

( or even on a web site )

tomorrow i'll see if i can make a Daz Script version that creates the plain-html page

and i'll see if my google-site accepts to embed the javascript

mCasual

mjc1016 said:

here's an online version of it http://mcasual.x10.mx/mcjMosaic.html

other wild speculation : maybe your browser cache is too small or some security settings prevents the use of a cache

maybe you attempt to save the page before Google had time to completely download/display it - that would make sense
google would then save some images to disk from the cache and others from downloading them

also, if you save the html twice using the same name, then the images from the two download will have identity crisis
that's one reason why i saved it under the name JapanUenoPark.html and not mcjMosaic.html

mCasual

yep that's probably it,
avoid re-using the same filename

mjc1016

Casual said:

mjc1016 said:

saving images to disk

maybe maybe maybe place the mcjMosaic.html elsewhere on your disk

( or even on a web site )

tomorrow i'll see if i can make a Daz Script version that creates the plain-html page

and i'll see if my google-site accepts to embed the javascript

I'm on Linux and yes, I have read/write for the temp directory, the Chrome cache is in my home folder, and I'm working out of the home folder.

I will give it a run as root, to see if it is a permissions problem.

The compositing is working fine...except for the fact that the tiles aren't in any sane order, out of Seamonkey. On one run the pic in the upper left corner was cbk 46. Another, it was cbk 37. Two different locations....all runs of the same location, are the same numbering scheme. But I'm not sure if they are the same for each session...I haven't tried that one, yet.

mCasual

mjc1016 said:

your browser probably starts many image downloads at once
and as the files come in, it starts others
each time assigning a different CBKNumber

whereas google chrome on windows7 probably uses just 1 download thread
and the order is well ordered

mCasual

mjc1016 said:

hey i was on Oprah

kidding kidding but i tested the system with the Opera browser , probably an Opera from last Christmas and it worked well

i would think Opera exists for Linux

---

you may also be able to use a Print-to-fax-as-tif
or print to pdf
or print to image

i tried a print to Microsoft XPS file but it didnt work, it was promising i was "printing" it on D-Size "paper"

mCasual

mjc1016 said:

Linux

mcjMosaicLinuxCurler.html a solution for Linux

For Linux Eyes Only

Linux includes the curl tool which can be used to download files from the net

the syntax is curl -o outputfilename URL

so i include herein mcjMosaicLinuxCurler.html

direct link to the zip file
https://sites.google.com/site/mcasualsdazscripts5/anywhereintheworld/mcjMosaicLinuxCurler.zip?attredirects=0&d=1

or the anywhereintheworld page
https://sites.google.com/site/mcasualsdazscripts5/anywhereintheworld

an html page and javascript code
which will print on-screen a batch file
which can then be used to download the 91 images that form the mozaic
so all you need is to be able to figure how to create a batch file and run it in Linux

the output of mcjMosaicLinuxCurler.html looks like this ( see Figure 1 )

( note that i only tested this using Curl for windows and a .bat file )

lets test a new location !!

ok you pick one ?

ok me ... hmm what song did i play yesterday

i played Skyfall

because i had the word SkyBall in mind

this version https://www.youtube.com/watch?v=iZdBVjzIMSM

soooo

i will google-map-search for skyfall

Skyfall Mobile Zip Line Hire Ltd

the url .... i wont paste it here ! it's 2 ft long

but i paste it in mcjMosaicLinuxCurler.html

and faster than the eye can see ! i got my curler batch file

it looks like this

curl -o cbk "http://cbk0.google.com/cbk?output=tile&panoid=tXBV6Y5TOtFky8-7nS9P2Q&zoom=4&x=0&y=0";curl -o cbk(1) "http://cbk0.google.com/cbk?output=tile&panoid=tXBV6Y5TOtFky8-7nS9P2Q&zoom=4&x=1&y=0";curl -o cbk(2) "http://cbk0.google.com/cbk?output=tile&panoid=tXBV6Y5TOtFky8-7nS9P2Q&zoom=4&x=2&y=0";curl -o cbk(3) "http://cbk0.google.com/cbk?output=tile&panoid=tXBV6Y5TOtFky8-7nS9P2Q&zoom=4&x=3&y=0";curl -o cbk(4) "http://cbk0.google.com/cbk?output=tile&panoid=tXBV6Y5TOtFky8-7nS9P2Q&zoom=4&x=4&y=0";...curl -o cbk(12) "http://cbk0.google.com/cbk?output=tile&panoid=tXBV6Y5TOtFky8-7nS9P2Q&zoom=4&x=12&y=0";curl -o cbk(13) "http://cbk0.google.com/cbk?output=tile&panoid=tXBV6Y5TOtFky8-7nS9P2Q&zoom=4&x=0&y=1";curl -o cbk(14) "http://cbk0.google.com/cbk?output=tile&panoid=tXBV6Y5TOtFky8-7nS9P2Q&zoom=4&x=1&y=1";...curl -o cbk(89) "http://cbk0.google.com/cbk?output=tile&panoid=tXBV6Y5TOtFky8-7nS9P2Q&zoom=4&x=11&y=6";curl -o cbk(90) "http://cbk0.google.com/cbk?output=tile&panoid=tXBV6Y5TOtFky8-7nS9P2Q&zoom=4&x=12&y=6";

i run this batch file in a folder containing curl.exe

and a few seconds later i got my 91 cbk image tiles ( which by the way are in JPG format )

i run mcjMontage.bat

and bam i got my panorama

my skyfall skyball

Fig. 3/4 Who is Zumba? and shouldnt we ask Zumba before giving him/her a whirl?

( wikipedia: is a dance fitness program created by Colombian dancer and choreographer Alberto "Beto" Perez during the 1990s )

Esemwy

Thanks for the script, Casual. I just created a render of a cartoon hippo on my front lawn, and it all works out great once I work around the windows-isms.

To make my life easier, since I use OS X, I wrote a script to extract the filenames from the generated HTML file. This guarantees that I get them in the right order. Because I'm lazy, I found some code to create the mosaic right there in the script.

The script is written in Python (included by default on OS X), and uses the Pillow module to create the mosaic. For those without Pillow installed, it falls back to ImageMagick.

Perhaps someone will find it useful.

python mcjMosaic.py path/to/html-file.html

The output will be in a file named like "Montage 2015-06-09 at 11.00.34.png" in your current directory. If you'd prefer JPEG files, you can easily change the extension in the parameters section near the top of the script.

#!/usr/bin/env python# Based on <a href="http://stackoverflow.com/questions/17555345/creating-a-montage-of-pictures-in-python">http://stackoverflow.com/questions/17555345/creating-a-montage-of-pictures-in-python</a>;from sys import path# needed for some package installs, harmless otherwisepath.append('/usr/local/lib/python2.7/site-packages')import osimport sysfrom time import strftimePIL_INSTALLED = Truetry:    from PIL import Image    from PIL import ImageDrawexcept:    PIL_INSTALLED = False    from subprocess import callimport re# parametersrow_size = 13margin = 0extension = '.png'def generate_montage(filenames):    images = [Image.open(filename) for filename in filenames]    width = 0    height = 0    i = 0    sum_x = max_y = 0     width = max(image.size[1]+margin for image in images)*row_size    height = sum(image.size[0]+margin for image in images)    montage = Image.new(mode='RGBA', size=(width, height), color=(0,0,0,0))    draw = ImageDraw.Draw(montage)    offset_x = offset_y = 0    i = 0    max_y = 0    max_x = 0    offset_x = 0    for image in images:        montage.paste(image, (offset_x, offset_y))        max_x = max(max_x, offset_x+image.size[0])        if i % row_size == row_size-1:             offset_y += max_y+margin            max_y = 0            offset_x = 0        else:            offset_x += image.size[0]+margin            max_y = max(max_y, image.size[1])        i += 1    if i % row_size:        offset_y += max_y    filename = strftime("Montage %Y-%m-%d at %H.%M.%S"+extension)    # montage = montage.crop((0, 0, max_x, offset_y))    montage.save(filename)def generate_montage_magick(filenames):    files = " ".join(filenames)    filename = strftime("Montage %Y-%m-%d at %H.%M.%S"+extension)    params = ['montage', '-geometry', '+0+0', '-tile', '13x7']+filenames+[filename]    print ' '.join(params)    call(params)def main(html):    pat = re.compile(r'src="([^"]+)"')    with open(html,'r') as fd:        text = fd.read()    files = [os.path.join(os.path.dirname(html),m) for m in re.findall(pat,text)]    try:        if len(files) > 1:            if PIL_INSTALLED:                generate_montage(files)            else:                generate_montage_magick(files)    except Exception as e:        print eif __name__ == '__main__':    main(sys.argv[1])

mCasual

Esemwy said:

python

come to think of it one could also do it in html5

i'm reading here t hat converting the html5 canvas to image is as simple as

var canvas = document.getElementById('example'),
    dataUrl = canvas.toDataURL(),
    imageFoo = document.createElement('img');
imageFoo.src = dataUrl;

// Style your image here
imageFoo.style.width = '100px';
imageFoo.style.height = '100px';

// After you are done styling it, append it to the BODY element
document.body.appendChild(imageFoo);

mjc1016

Well, I just tested Esemwy's Python script and it works quite well...

I'll give the curl method a try later, still trying to get my yard mowed before a thunderstorm blows in.

mCasual

i have a fully HTML5/Javascript solution coming up! in the next minutes !

as simple as
1 - paste the google maps url in the box
2 - click the submit button, wait 3 seconds
3 - do a Save As

mCasual

HTML5 To The Rescue

It's almost as if we were in 2015!

this new version is fully contained in a web page
( javascript + HTML5 )

Your browser needs to support HTML5 in a way similar to how Google Chrome on Windows 7 does

Get mcjMosaicHTML5.html from the download/manual page
https://sites.google.com/site/mcasualsdazscripts5/anywhereintheworld
or here's a direct link
https://sites.google.com/site/mcasualsdazscripts5/anywhereintheworld/mcjMosaicHTML5.html?attredirects=0&d=1

1 - copy&paste; your google-maps-streetview url in the textbox
2 - click the submit button

the panorama-mosaic will build up

when it's complete your browser is unceremoniously sent to the location of the panorama-as-an-image

it's a jpeg !

which you can do "Save image as..." or "Copy"

"Save Page As" may also work

Figure 1
Piazza San Pietro Rome

the nice thing is, even if we cant use the images for commercial purposes,
we can use it as a reference and 3d-build those sites

Fig 2 seems to work fine with the google street images that are taken at some spots by ... contributors
also in Rome --- labeled "Maan Servizi S.r.l. - Identity - See inside - Mar 2015"
apparently this sphere is not watermarked to Google, maybe some have permissive licenses?

Fig 3 spain

mCasual

Esemwy said:

... python code ...

if it's ok with you i could copy your forum post with the python code
and place it in a section called "The Python / MAC Way"

in the https://sites.google.com/site/mcasualsdazscripts5/anywhereintheworld page

Esemwy

Casual said:

Esemwy said:

... python code ...

if it's ok with you i could copy your forum post with the python code
and place it in a section called "The Python / MAC Way"

in the https://sites.google.com/site/mcasualsdazscripts5/anywhereintheworld page

That's fine with me. I have some minor updates.

This version takes the Google Maps URL (in quotes to keep the shell from freaking out) and does all the work necessary to download the tiles and create a montage. It requires the Python 'requests' module.

#!/usr/bin/env python# Based on <a href="http://stackoverflow.com/questions/17555345/creating-a-montage-of-pictures-in-python">http://stackoverflow.com/questions/17555345/creating-a-montage-of-pictures-in-python</a>;from sys import path# needed for some package installs, harmless otherwisepath.append('/usr/local/lib/python2.7/site-packages')import osimport sysfrom time import strftimeimport requestsfrom io import BytesIOPIL_INSTALLED = Truetry:    from PIL import Image    from PIL import ImageDrawexcept:    PIL_INSTALLED = False    from subprocess import callimport re# parametersrow_size = 13extension = '.png'url = 'http://cbk0.google.com/cbk'def generate_montage(files):    images = [ Image.open(file) for file in files ]    width = 0    height = 0    i = 0    sum_x = max_y = 0     width = max(image.size[1] for image in images)*row_size    height = max(image.size[0] for image in images)*len(images)/row_size    montage = Image.new(mode='RGBA', size=(width, height), color=(0,0,0,0))    draw = ImageDraw.Draw(montage)    offset_x = offset_y = 0    i = 0    max_y = 0    max_x = 0    offset_x = 0    for image in images:        montage.paste(image, (offset_x, offset_y))        max_x = max(max_x, offset_x+image.size[0])        if i % row_size == row_size-1:             offset_y += max_y            max_y = 0            offset_x = 0        else:            offset_x += image.size[0]            max_y = max(max_y, image.size[1])        i += 1    if i % row_size:        offset_y += max_y    filename = strftime("Montage %Y-%m-%d at %H.%M.%S"+extension)    # montage = montage.crop((0, 0, max_x, offset_y))    montage.save(filename)def generate_montage_magick(files):    filenames = []    for i, file in enumerate(files):        name = '/tmp/cbk_{:02d}.jpg'.format(i)        open(name,'w').write(file.read())        filenames.append(name)    filename = strftime("Montage %Y-%m-%d at %H.%M.%S"+extension)    params = ['montage', '-geometry', '+0+0', '-tile', '13x7']+filenames+[filename]    print ' '.join(params)    call(params)def extractPanoid( mapsLink ):    fields = mapsLink.split( "!" )    for f in fields:        if f.startswith('1s'):            return f[2:102]    return Nonedef downloadAll(mapsLink):    panoid = extractPanoid( mapsLink )    files = []    for y in xrange(0,7):        for x in xrange(0,13):            payload = {                'output' : 'tile',                'panoid' : panoid,                'zoom'   : 4,                'x'      : x,                'y'      : y            }            r = requests.get(url, params=payload)            files.append(BytesIO(r.content))    try:        if len(files) > 1:            if PIL_INSTALLED:                generate_montage(files)            else:                generate_montage_magick(files)    except Exception as e:        print e    def main(html):    pat = re.compile(r'src="([^"]+)"')    with open(html,'r') as fd:        text = fd.read()    files = [os.path.join(os.path.dirname(html),m) for m in re.findall(pat,text)]    try:        if len(files) > 1:            if PIL_INSTALLED:                generate_montage(files)            else:                generate_montage_magick(files)    except Exception as e:        print eif __name__ == '__main__':    downloadAll(sys.argv[1])

mCasual

Esemwy said:

...

That's fine with me. I have some minor updates.

New Section - The Esmwy Python way for MACs and Linux

https://sites.google.com/site/mcasualsdazscripts5/anywhereintheworld

i copied the text from the forum and did a save-as-plain-text

to create the two Python files
so i guess i should or someone else :D should check if it didnt break the annoying Python indentation laws

maybe the html source of the forum ...

mCasual

in case someone someday googles about HTML5 canvas-to-image

here's the main HTML code of mcjMosaicHTML5.html

well except for the dangerous codes the forum software removed

 

var g_mosaic_canvas;var g_mosaic_context;var g_dimensionTile = 512;var theresultsarein = 0;function extractPanoid( mapsLink ){ var fields = mapsLink .split( "!" ) var count = fields.length for( var i = 0; i < count; i++ ) {  var str = fields[ i ];  var prefix = str.substring(0, 2) ;  if( prefix == "1s" )  {   return( str.substring(2, 100) )  } } return( 0 );}function drawShape( ){ var nTilesX = 13; var nTilesY = 7; var panoid  = document.getElementById('panoid').value; panoid = extractPanoid( panoid ); var widthCanvas = nTilesX * g_dimensionTile ; var heightCanvas = nTilesY * g_dimensionTile ; g_mosaic_canvas = document.getElementById( "mosaic_canvas" ); g_mosaic_context = g_mosaic_canvas.getContext( "2d" ); for( var y = 0; y < nTilesY; y++ ) {  for( var x = 0; x < nTilesX ; x++)  {   var path = 'http://cbk0.google.com/cbk?output=tile&panoid;=' + panoid + '&zoom=4&x=' + x + '&y=' + y;   var cat = new Image();   cat.crossOrigin = "Anonymous";   cat.posx = x;   cat.posy = y;   cat.onload = function() {    var x = this.posx;    var y = this.posy;    g_mosaic_context.drawImage( this, x * g_dimensionTile , y * g_dimensionTile );     ++theresultsarein;    if( theresultsarein == 91 )    {         var daurl = g_mosaic_canvas.toDataURL( "image/jpeg", 0.8 );     document.location = daurl;    }   }   cat.src = path;  } }}<br>Enter your google streetview URL here and click on submit<BR><input type="text" size=128 id="panoid" value=""/><button  href="[removed];">Submit<<br><canvas id = 'mosaic_canvas' width = 6656 height = 3584>

 

English Bob

This may just be the best thing in the world, ever. :)

I'm using Chrome in Windows 7, but the HTML5 version is giving me an error message rather than the final JPEG. Any ideas, or things I can do to help debug it?

Esemwy

Casual said:

Esemwy said:

...

That's fine with me. I have some minor updates.

New Section - The Esmwy Python way for MACs and Linux

https://sites.google.com/site/mcasualsdazscripts5/anywhereintheworld

i copied the text from the forum and did a save-as-plain-text

to create the two Python files
so i guess i should or someone else :D should check if it didnt break the annoying Python indentation laws

maybe the html source of the forum ...

If you're worried about maintaining code formatting, perhaps it would be easier to link to the GitHub gist I created.

<!-- script src="https://gist.github.com/esemwy/75b9ef7fd042d4947745.js"><!--/script>;

I added the "!--" to the tags above to keep the forum software from eating it. It'll embed nicely formatted source and add a helpful link to the raw file.

DigiDotz

I get as far as the mcjMontage.bat , double click to run within saved webpage directory, but get this (attached image)

English Bob

English Bob said:

... the HTML5 version is giving me an error message ...

Further to that - and apologies for the multi-threaded thread - it works for me in Firefox, but I get a similar error message in Opera. In IE10, the image apparently downloads in full but it never goes to the final JPEG. I have a solution now, anyway: use Firefox.

Kalisx

Thank you so much for this great tool :-)

Here is a quick render.
StreetView in Cyberfox (Firefox x64) + mcjMosaicHTML5 + sketch filter in paint software + mcjSkySphere.

mCasual

English Bob said:

English Bob said:

... the HTML5 version is giving me an error message ...

Further to that - and apologies for the multi-threaded thread - it works for me in Firefox, but I get a similar error message in Opera. In IE10, the image apparently downloads in full but it never goes to the final JPEG. I have a solution now, anyway: use Firefox.

there's a security feature, i dont know if it's in html5 or in browsers
but since mcjMosaicHTML5.html pulls images from google.com
something or someone marks my mozaic as "tainted"
and prevents the mozaic from being converted into a solid image

that's why there's a line in mcjMosaicHTML5.html that reads

cat.crossOrigin = "Anonymous";

it's the first time i encountered this annoyance

maybe maybe using Notepad, if you replace this line with

cat.setAttribute('crossOrigin', 'anonymous');

maybe it will work with other browsers

also, in the Google-Chrome settings, maybe there's a setting to loosen the security concerning crossOrigin
i saw it refered to as CORS also

mCasual

DigiDotz said:

I get as far as the mcjMontage.bat , double click to run within saved webpage directory, but get this (attached image)

were the cbk cbk(1) cbk(2) files in the same folder as mcjMontage.bat?

because mcjMondage.bat is basically ordering imagemagick to take the images from "right here where i, mcjMontage.bat am located"

mCasual

Esemwy said:

<!-- script src="https://gist.github.com/esemwy/75b9ef7fd042d4947745.js"><!--/script>;

I added the "!--" to the tags above to keep the forum software from eating it. It'll embed nicely formatted source and add a helpful link to the raw file.

i updated the Esemwy_Version_2.py with that version

i'll also see if i can link to yout github page since there may be future updates and documentation