Forum.Tip.It: How to use Google Docs to extract GE prices ~By Brainymidget - Forum.Tip.It

Jump to content

  • (6 Pages) +
  • 1
  • 2
  • 3
  • Last »
  • You cannot start a new topic
  • You cannot reply to this topic

How to use Google Docs to extract GE prices ~By Brainymidget

#1
User is offline   brainymidget  [ View Display Name History ]

  • TET Member
  • View gallery
  • Group: Clan Official
  • Posts: 822
  • Joined: 02-October 06
  • Location:Case Western Reserve University
  • Status:None
  • RSN:Brainymidget
  • Clan:SoDB
Google Docs is essentially like Microsoft Office, and the spreadsheet form which we will be using is essentially like Excel, but it has a helpful feature which is that it can extract data from the internet(Although I recently found out Excel can as well but I haven't found a way to do it as efficiently so I'm sticking with Google Docs.)

Extracting prices on the GE can be helpful for many things, the biggest one is making calculators. I make lots of Gp / Xp calculators and I use this so that they are always up to date.

So ya, on with the guide.



How to use Google Docs




ImportHtml




Index




Concat




Making a calculator




So there you go, you can now make an always updating calculator with prices straight from the GE database.

Once you're done with it all, you should have a finished product something like this.

Posted Image
Posted Image
Posted Image

#2
User is offline   runite_ore  [ View Display Name History ]

  • Chicken Feather
  • Group: Members
  • Posts: 20
  • Joined: 11-December 06
  • RSN:ggg0o0
When i extract the price of runite ore, it returns 16.1k and the "k" makes the spreadsheet fail to calculate the cost of smelting runite bar. What can i do to make it calculate correctly? Please help!
Posted Image
1113 total. Always f2p.

#3
User is offline   brainymidget  [ View Display Name History ]

  • TET Member
  • View gallery
  • Group: Clan Official
  • Posts: 822
  • Joined: 02-October 06
  • Location:Case Western Reserve University
  • Status:None
  • RSN:Brainymidget
  • Clan:SoDB
Hmm, I honestly don't know. I'll take a look into it and tell you if I find out how to make it work.
Posted Image
Posted Image

#4
User is offline   thaa  [ View Display Name History ]

  • Chicken Feather
  • Group: Members
  • Posts: 1
  • Joined: 06-August 06
  • Status:Hide
Hello, I tried creating formula for parsing the "m" and "k" prices.

The formula would be very big if I would have to merge it with the importhtml formula, so the value loaded from the price list is in D2.

=if(iferror(find("m",D2),false),left(D2,find("m",D2)-1)*1000000,if(iferror(find("k",D2),false),left(D2,find("k",D2)-1)*1000,D2))


here is a snapshot:

Posted Image



BTW: Thank you for this guide. Really great idea.

#5
User is offline   epicnuts  [ View Display Name History ]

  • Goblin Armour
  • Group: Members
  • Posts: 97
  • Joined: 30-October 08
  • Location:Belgium
  • Status:P2P
  • RSN:zoomkey
  • Clan:Zeitphasm
I so love you <3: <3: <3:

I asked this to sven bohikus, but he didn't reply (he had a guide for tracking xp)

realy, thanks for doing this
Posted Image

#6
User is offline   brainymidget  [ View Display Name History ]

  • TET Member
  • View gallery
  • Group: Clan Official
  • Posts: 822
  • Joined: 02-October 06
  • Location:Case Western Reserve University
  • Status:None
  • RSN:Brainymidget
  • Clan:SoDB

epicnuts said:

I so love you <3: <3: <3:

I asked this to sven bohikus, but he didn't reply (he had a guide for tracking xp)

realy, thanks for doing this




Ya, I've used svens guide for a while to track competitions within my community. I based this largely off that, I just had to ImportHtml instead of ImportData.
Posted Image
Posted Image

#7
User is offline   mister_moocky  [ View Display Name History ]

  • Ghost Cloak
  • View gallery
  • Group: Members
  • Posts: 1,950
  • Joined: 09-June 08
  • Location:Alberta, Canada
  • Status:None
  • RSN:lMl MrMoocky
  • Clan:codguy (fsc)

runite_ore said:

When i extract the price of runite ore, it returns 16.1k and the "k" makes the spreadsheet fail to calculate the cost of smelting runite bar. What can i do to make it calculate correctly? Please help!


I'm getting the same problem with the + signs on the price changes. It regonizes - as negatives, but the + is treated as a character, which messes it up.



thaa said:

Hello, I tried creating formula for parsing the "m" and "k" prices.

The formula would be very big if I would have to merge it with the importhtml formula, so the value loaded from the price list is in D2.

=if(iferror(find("m",D2),false),left(D2,find("m",D2)-1)*1000000,if(iferror(find("k",D2),false),left(D2,find("k",D2)-1)*1000,D2))


I presume it's possible to make something that gets rid of + signs?
quit

#8
User is offline   jjjon123  [ View Display Name History ]

  • Warrior of Redwall
  • Group: Members
  • Posts: 1,166
  • Joined: 11-June 07
  • Location:SoCal W00t
  • Status:P2P
  • RSN:jjjon123
  • RSN2:Kirbybakatya
I made some F2P high alch sheets real quick... Check'em out :)





Armor:

http://spreadsheets.google.com/ccc?key= ... WhBqpWmUaQ



Jewelry & Sets:

http://spreadsheets.google.com/ccc?key= ... UzqFLvLwfw
Posted ImagePosted Image
Posted ImagePosted Image
Posted ImagePosted Image
Posted ImagePosted Image
Posted Image1,000 F2P Total Level Reached 10/8/10 !



WOT WOT!

☉.☉☂

#9
User is offline   fbswift  [ View Display Name History ]

  • Rat Meat
  • Group: Members
  • Posts: 42
  • Joined: 27-August 08
  • Status:Hide
so if f2p then high alch rune longswords? thats pretty helpful



im going to go and buy 50k rune longswords then tell everyone about this
Posted Image

#10
User is offline   knight10071  [ View Display Name History ]

  • Bear Fur
  • Group: Members
  • Posts: 410
  • Joined: 08-January 06
  • Location:Location doesn't matter, destination does!
  • Status:P2P
  • RSN:Aurei Animus
Thanks a lot! I was kinda looking for this and I've now updated my MTK sheets with this method of drawing prices out. Now, I've got one question: how often does this update? Every 24 hours, or every time someone opens it?
Posted Image

#11
User is offline   brainymidget  [ View Display Name History ]

  • TET Member
  • View gallery
  • Group: Clan Official
  • Posts: 822
  • Joined: 02-October 06
  • Location:Case Western Reserve University
  • Status:None
  • RSN:Brainymidget
  • Clan:SoDB
Well with Hi-scores, which should be the same as extracting from the GE database, it updates every 1 hour, or whenever I refreshed all the data in my spreadsheet, but I never really do that so it's pretty much every 1 hour.
Posted Image
Posted Image

#12
User is offline   Sentry_Wolf  [ View Display Name History ]

  • Follower Of The Crate
  • Group: Members
  • Posts: 1,178
  • Joined: 04-December 06
  • Status:Retired
Thank you Brainy!! I can have a quick and easy sheet for my herblore guide. :) <3:



http://spreadsheets.google.com/pub?key= ... iureEDFSMw

Hehe!



This guide rocks!!! <3:

Posted Image
Hail the Crate

#13
User is offline   brainymidget  [ View Display Name History ]

  • TET Member
  • View gallery
  • Group: Clan Official
  • Posts: 822
  • Joined: 02-October 06
  • Location:Case Western Reserve University
  • Status:None
  • RSN:Brainymidget
  • Clan:SoDB

Sentry_Wolf said:

Thank you Brainy!! I can have a quick and easy sheet for my herblore guide. :) <3:



http://spreadsheets.google.com/ccc?key= ... FSMw&hl=en

Hehe!



This guide rocks!!! <3:






Glad to help, and by the way, the URL you posted links to the page where you edit the spread sheet. You don't have it set so that people can edit or view your document, so people can't view it. What you need to do is click Share > Publish as a web page, then it will give you the link to it.
Posted Image
Posted Image

#14
User is offline   Sentry_Wolf  [ View Display Name History ]

  • Follower Of The Crate
  • Group: Members
  • Posts: 1,178
  • Joined: 04-December 06
  • Status:Retired
Thanks, heres the right link now. :)



http://spreadsheets.google.com/pub?key= ... iureEDFSMw

Posted Image
Hail the Crate

#15
User is offline   llcoolguy972  [ View Display Name History ]

  • Skeleton Shield
  • Group: Members
  • Posts: 1,024
  • Joined: 28-August 05
  • Status:Hide
Awesome guide. Made this ranged calc yesterday.



By the way, if anyone needs to pull stat experience from the high scores the formula is: =Index(ImportHtml(Concat("http://hiscore.runescape.com/hiscorepersonal.ws?user1=",B1), "table", 1), 7,5). All you have to change is B1 to your user/cell where your user's in and the bolded 7, which is the row your skill is.

#16
User is offline   rsInvestorr  [ View Display Name History ]

  • Rat Meat
  • Group: Members
  • Posts: 33
  • Joined: 12-January 09
Any ides where I can find the data for total trade volumes? The data is there somewhere because they use it for the top 100 most traded items, but I would like to be able to poll the data for other items as well.

#17
User is offline   brainymidget  [ View Display Name History ]

  • TET Member
  • View gallery
  • Group: Clan Official
  • Posts: 822
  • Joined: 02-October 06
  • Location:Case Western Reserve University
  • Status:None
  • RSN:Brainymidget
  • Clan:SoDB
I don't think that it's public information for anything except the top 100.
Posted Image
Posted Image

#18
User is offline   PatrickMc  [ View Display Name History ]

  • Chicken Feather
  • Group: Members
  • Posts: 1
  • Joined: 26-March 09
  • Status:Hide
To extract prices and other numeric or non-numeric values from html tables, there is a very good script posted at http://www.biterscri...om/install.html .



Now, to take care of the k (1000) and m (1000000) notations, I would add the following at the end of that script.



while ( { sen r -c "^;k^" $csv } > 0 )

    sal -r -c "^;k^" ",000" $csv > null



while ( { sen -r -c "^;m^" $csv } > 0 )

    sal -r -c "^;m^" ",000,000" $csv > null




Add the above before the echo $csv line in the script. I am using -c (case insensitive option) and -r (regular expression), because k and m may also appear as "K or "M" or " K" or " M", etc.



Patrick

#19
User is offline   brainymidget  [ View Display Name History ]

  • TET Member
  • View gallery
  • Group: Clan Official
  • Posts: 822
  • Joined: 02-October 06
  • Location:Case Western Reserve University
  • Status:None
  • RSN:Brainymidget
  • Clan:SoDB
That doesn't work with GoogleDocs, GoogleDocs uses the same kind of code as Excel. And someone already posted how to convert the m's and the k's with Google Docs.
Posted Image
Posted Image

#20
User is offline   primadog  [ View Display Name History ]

  • Varrock Guard
  • View gallery
  • Group: Members
  • Posts: 1,327
  • Joined: 09-July 04
  • Status:None
  • RSN:DogPrima
Why is all your query types =ImportHtml("http://itemdb-WOW.runescape.com/results.ws?query=Willow Logs", "table", 2)



instead of



=ImportHtml("http://itemdb-rs.runescape.com/results.ws?query=Willow Logs", "table", 2)





Oh wait... don't tell me... -.- what a lame April Fools
All I learned in life, I learned on Tip.it

Share this topic:


  • (6 Pages) +
  • 1
  • 2
  • 3
  • Last »
  • You cannot start a new topic
  • You cannot reply to this topic

1 User(s) are reading this topic
0 members, 1 guests, 0 anonymous users