Meeting 2018-01-26

Future Tasks

- Changes are noted by Bold
  • Solve the installation problem 
    • Reconstruct AsterixDB install guide 
    • - Qiushi, Chen, Taewoo
  • Frontend refactoring - Teyu
  • Take Multiple-Color-Pointmap as start point - Aaron
  • "geoCell" & "getPoint" function - Qiushi
  • Wrap the conf file parameters loaded by Twittermap - Qiancheng
  • Tableau Evaluation - larger data set - Li Deng
  • Layers of Frontend - Yang Cao
  • Comparison with Oracle - Jiliang Ni

Achievements
  • Generate "CountMap" and "PointMap" on Tableau - Li Deng
  • Successfully imported tweets data to Oracle - Jiliang Ni
  • Show tweets on layered UI experiment - Yang Cao
  • Stop words merged - Qiancheng
  • PointMap Parameter Configuration merged - Qiushi
Notes
  • 1.48M records of Sample TwitterData (2017-Jul-01~07). (.zip) 382MB --> (.json) 1.6GB
  • 14.6M records of Sample TwitterData (2017-Jul-01~Sep-01). (.zip) 4GB --> (.json) 16GB

Comments

Post a Comment

Popular posts from this blog

Meeting 2018-02-02

Future Tasks - Changes are noted by  Bold Reconstruct AsterixDB install guide  -  Qiushi Maintenance jobs - Qiushi Frontend refactoring - Teyu Take Multiple-Color-Pointmap as start point - Aaron "geoCell" & "getPoint" function - Qiushi Wrap the conf file parameters loaded by Twittermap  - Qiancheng Tableau Evaluation - larger data set - Li Deng Goes down to performance issue, pulling data from AsteridDB, like Nik's work - Yang Cao Comparison with Oracle - more experiments - Jiliang Ni Achievements Solve the AsterixDB installation problem   -  Taewoo Run Oracle and import Tweets data into Oracle - Jiliang Ni Load different layers of data into UI - Yang Cao Show 2 colors of points on map - Aaron Notes Rename "Point Map" to "Pin Map" - suggestion Build specific keywords (e.g. "HIV") TwitterMap instances - Colaboraters
Read more

TODOs - Mar 16 2018

Frontend (Twittermap)  - Right sidebar is hidden by scrollbar  - Pinmap left coner tool box needs to be updated or removed  - Popup Tweet content by talking to our own DB - Qiancheng is working  - Integrate multi-layered frontend feature  - Enabling time series bar data caching Bugs  - First time search for a new keyword, the slicing queries might be stuck as the second mini-query.  - "Future timeout" exception (where and when is not known now, sometimes when starting the TM) Features  - New 47000 size Sample Data (with user.pic_url attribute) is needed for Quick-Start guide environment  - HIVmap should be merged into our Github repository in some way.  - Supporting "Geocell group by" queries with arbitrary scale (currently is fixed) as parameter in Cloudberry  - A Guard monitoring our whole system's status  - Randomly generate coordinate for each tweet which does not have coordinate value during geotagging preprocessing Other
Read more

Meeting 2018-01-12

Independent Tasks for new members (1) Tableau Evaluation     - Related to this blog ;     - Tableau website: https://www.tableau.com/     - Instructions:         - Install the software         - Put some sample data into it         - Play around with its features and UIs, get some sense of its power         - Look deeper into it and try to translate what kinds of queries can Tableau answer and evaluate how fast it can reply (2) Layers of Frontend     - Take Google Maps as an example, it allows realtime add or remove different layers of dataset: e.g. Terrain, Traffic, Bicycling routes, Satellite, etc.     - Explore how to implement a frontend with such features of realtime adding and removing layers of different datasets     - Instructions:         - Find some techniques or libraries to do this         - Do a toy demo to get some sense of how it works and how to implement this         - Then we will see how to implement this based on our current codebase (3) Compariso
Read more