Did you miss your activation email?
Pages: [1]
  Print  
Author Topic: Integration of Online Store Price Lists into price roundup forums  (Read 2032 times)
wingman
Jr. Member
**
Offline Offline

Posts: 76


View Profile
« on: September 20, 2010, 09:10:10 PM »


There are a few sites providing online store price (such as mine - GameCafe) which lists online store prices for games...  I think it would be great to integrate the price list info directly into the price roundup forums on EG.

For example ... http://www.gamecafe.com.au/GamePrices.aspx?p=All&Search=mafia+2

The data from my site would be useful as a starting point for discussions on price roundup forums.

I would be happy to work with the admin team at EG to integrate the data, if anyone thinks it would be a good idea.

Cheers,
WingMan.
Logged
quix
Jr. Member
**
Offline Offline

Posts: 55



View Profile
« Reply #1 on: September 21, 2010, 06:30:33 AM »

As a member, I think its a great idea - except that pricing changes dynamically from stores (eg look at the front page here - many 1 or 2 day specials) - and Gamecafe updates by using trawl bots which are sometimes weeks out of date for many sites (or havent trawled for that item at all)

Would be better if stores provided feeds to Ecogamer direct, and bots validated current pricing - if there is too many mismatches (ie possible baiting) then investigate. I cant see this working with Gamecafe, as they dont accept live feeds from what I understand and rely on the trawl bots

Perhaps feeds can be sent straight to ecogamer? I know many stores already have live feeds as they do this to appear of Getprice etc - so perhaps using a feed that already exists and sample it for items of interest?

Logged
Aquil0
Full Member
***
Offline Offline

Posts: 111


My form of transport


View Profile
« Reply #2 on: September 21, 2010, 09:15:04 AM »

Oh my god, do you understand how much work that is!
Coming from a web dev point of view its like saying.

"Ferrari, Toyota and Holden have just released there engine blueprints to the public. Youre a mechanic; build me an engine that uses the cylinders from the F355 the hybrid tech from the toyota and bogan  Grin from the Holden... All for free please!"

Not to mention that these companies all have there own data formats, and languages. And they dont need to inform ecogamer of a change in the format. Not to mention alot of the deals we see come from bricks and mortar that dont have a constant web update.

The only way I could see this idea ever working is if all these companies agreed to used the same Twitter or and RSS feeds to provide the information (Good luck with that)

Im not saying its a bad idea or that it cant be done, and I dont even know if such feed already exist.
But its just sound like more head F*** then what its worth. Exspesh when you can just send a link to the site above.
« Last Edit: September 21, 2010, 09:24:03 AM by Aquil0 » Logged
wingman
Jr. Member
**
Offline Offline

Posts: 76


View Profile
« Reply #3 on: September 21, 2010, 06:14:39 PM »

As a member, I think its a great idea - except that pricing changes dynamically from stores (eg look at the front page here - many 1 or 2 day specials) - and Gamecafe updates by using trawl bots which are sometimes weeks out of date for many sites (or havent trawled for that item at all)

Would be better if stores provided feeds to Ecogamer direct, and bots validated current pricing - if there is too many mismatches (ie possible baiting) then investigate. I cant see this working with Gamecafe, as they dont accept live feeds from what I understand and rely on the trawl bots

Perhaps feeds can be sent straight to ecogamer? I know many stores already have live feeds as they do this to appear of Getprice etc - so perhaps using a feed that already exists and sample it for items of interest?



As the GameCafe site administrator, the trawl bots we use discard data after 3 days, so no price on the website is more than 3 days old by definition, but it does rely on trawling.  In some instances we are processing data feeds when webmasters have provided them to us. 

I could provide all the data in a standard format (xml, JSOM, ATOM or whatever) - so the EG guys wouldn't need to waste time worrying about each and every store.  The algorithm has been updated recently, and it actually crawls all websites in our database fairly (breadth first, so to speak), so each and every store gets the same coverage over a given time period - so if the game isn't listed, it probably means it is out of stock, or that store doesn't have the game at all.

For less popular games, we don't try to keep them updated in the database, as it wastes valuable time and resources, when people are just interested in getting prices for the latest (popular) games.

I have to say, maybe just a link (as Aquil0 suggests) against each product would be easier!

Wingman
Logged
quix
Jr. Member
**
Offline Offline

Posts: 55



View Profile
« Reply #4 on: September 21, 2010, 08:28:43 PM »

Most companies DO use and provide the same feeds - as they all feed them to Getprice, Shopping.com etc (which standardises the format of the input feed in each case). You could ask them to point you to where they are for example......

Having said that, why not just go to Getprice, as the data is always updated every 24 hours or so, and doesnt rely on bots that **may** trawl a site.

I suppose Ive talked myself out of the useful ness of this entirely.

Logged
Anthony
Administrator
Life Member
*****
Online Online

Posts: 1348



View Profile
« Reply #5 on: September 21, 2010, 09:34:51 PM »

quix, Im not entirely certain ALL the websites in GameCafes database provide feeds and I would assume wingman would have investigated it fairly early on in development as it would save him time. Some sites simply consider their prices something they dont want compiled.

As far as integrating GameCafe with Economical Gamer I dont really have an answer. Maybe "not right now"? Apart from having very little time at the moment I dont see what advantage there is to having it on ecogamer.com.au. Why not just go straight to GameCafe.com.au?

The only opportunity I see is cross-promotion. Which I am some what hesitant to do simply because it will take focus away from our affiliate icons.

I certainly like your forward and transparent nature wingman so dont take my lack of enthusiasm personally. Perhaps there is an opportunity or idea I missed.
Logged
wingman
Jr. Member
**
Offline Offline

Posts: 76


View Profile
« Reply #6 on: September 21, 2010, 10:14:44 PM »


Some people might be interested, so...

As it turns out, only 3 web masters provide feeds for GameCafe.  We found that the feed data itself was an area of concern in early development, as the prices in the feed often didn't match the price listed on the web page, and most stores didn't have a feed, or their IS department was too busy to implement one for us.

Instead, the price fetching agent I have written processes the structure of the web pages and extracts price information directly off the page.  It uses a combination of the geometry of the page, regular expressions, and a wealth of a priori knowledge of what information to expect to extract the information... but its been a work in progress for a few years now, although recently we have upgraded server network capacity to 2 Terabytes of bandwidth per month, which has allowed me to increase the frequency of processing.

Some form of cross - promotion is probably the best idea, but it would have to done it a way not to distract from the affiliate links already posted on EG.  But in the end, if Gamers can find games more quickly, and cheaper - then we have won! 

Cheers,
Wingman

http://www.GameCafe.com.au/
Australia's Game Price Compare Search Engine.
Logged
Pages: [1]
  Print  
 
Jump to: