tumblr gear RSS

stfuawsc

Archive

Aug
26th
Wed
permalink
core concept
text-based scraping engine. (not dom-based. and almost all rules are written in regular expressions.)
metadata for scraping is located on outside of application. (s3)
dynamically create a page from tumblr html with *minimum* processing.
internal architecture
background loading queue. (nsoperationqueue. serial operation.)
background posting queue. (nsoperationqueue. parallel operation.)
2-layer cache. (html cache, webview cache.)
reusable & gradual warmup webview cache. (3 upwards, 1 current, 6 downwards. total 10 views. saving memory usage.)
metadata for scraping. (reading & writing through nsmutabledictionary.)
additional webview for browsing pages outside tumblr.
notification popup. (simple uiview & quartzcore.)
monitoring availability of network.
future plans
basic functions will be preferentially enhanced. (stability, performance, disaster tolerance and so on. then advanced functions.)
will be open-sourced.
metadata will be moved from s3 to wedata.

core concept

  • text-based scraping engine. (not dom-based. and almost all rules are written in regular expressions.)
  • metadata for scraping is located on outside of application. (s3)
  • dynamically create a page from tumblr html with *minimum* processing.


internal architecture

  • background loading queue. (nsoperationqueue. serial operation.)
  • background posting queue. (nsoperationqueue. parallel operation.)
  • 2-layer cache. (html cache, webview cache.)
  • reusable & gradual warmup webview cache. (3 upwards, 1 current, 6 downwards. total 10 views. saving memory usage.)
  • metadata for scraping. (reading & writing through nsmutabledictionary.)
  • additional webview for browsing pages outside tumblr.
  • notification popup. (simple uiview & quartzcore.)
  • monitoring availability of network.


future plans

  • basic functions will be preferentially enhanced. (stability, performance, disaster tolerance and so on. then advanced functions.)
  • will be open-sourced.
  • metadata will be moved from s3 to wedata.
  1. archiescherzjk reblogged this from tumblrgear
  2. reonald reblogged this from tantarotaro
  3. mizuki800 reblogged this from tantarotaro
  4. tantarotaro reblogged this from pcatan
  5. tokada reblogged this from takeori
  6. tajimaya reblogged this from reretlet
  7. travs reblogged this from tumblrgear and added:
    awesome iPhone app...highly recommended!
  8. hikol reblogged this from babie
  9. uchitaka reblogged this from wayayaya
  10. 29q-memo reblogged this from ak47
  11. kbcn reblogged this from tumblrgear
  12. interglacial reblogged this from do-nothing
  13. tk78 reblogged this from reretlet
  14. snp307 reblogged this from tumblrgear
  15. shingoym reblogged this from tumblrgear
  16. babie reblogged this from reretlet
  17. lunaryue reblogged this from reretlet
  18. hsmt reblogged this from kazcorp
  19. takeori reblogged this from reretlet
  20. kazcorp reblogged this from tumblrgear
  21. reretlet reblogged this from ak47
  22. browneyes reblogged this from ak47
  23. taxima2 reblogged this from vmconverter
  24. wayayaya reblogged this from monorainbows
  25. monorainbows reblogged this from ak47
  26. ak47 reblogged this from do-nothing
  27. vmconverter reblogged this from tumblrgear
  28. do-nothing reblogged this from tumblrgear
  29. loveanymore reblogged this from pcatan
  30. clavier reblogged this from tumblrgear
  31. pcatan reblogged this from tumblrgear
  32. crookedlane reblogged this from tumblrgear
  33. forstyx reblogged this from tumblrgear
  34. tumblrgear posted this