User
Welcome, Guest. Please login or register.
September 07, 2010, 02:46:08 PM

Login with username, password and session length

Search
News
Regular meetings: Tuesday at 10 PM EST at Pinnacle Pocket D.
Virtue night: Thursday at 9 PM EST.
Visit the RPC Wiki!
Server Status

Current Patch Notes:
Live - Test

Mendication Station
1&1 Internet, Inc.
Hosting solutions, domain registration and more.
</shamelessreferral>

Help a brotha out, yo.

The Entertainment Consumers Association
Support and protect your rights to game.

« previous next »
Pages: [1] Go Down Print
Author Topic: Software for ChatLog Cleaning, Take Three  (Read 1099 times)
Randompeach
Author
****
Offline Offline

Gender: Male
Posts: 147



« on: January 25, 2010, 07:23:33 PM »

Certainly not to upstage Tao and his awesome Log Cleaner, I've been tinkering and creating my own.

There are a few goals I have planned:
  • Focus on conversations, rather than the logs themselves
  • Make all of your conversations fully searchable, based on time/date, channel, toon name, or anything said in the chat from within the application
  • Save conversations as you would a playlist, for easy retrieval

In no way shape or form is this ready for public use, however I feel confident enough in its abilities for a limited alpha release. As this is limited, the link to the program, below, will be made available until Friday, March 19th. After that, the link will be disabled to prevent new downloads of an outdated program. As I do not work on this full time, the next release will be at some point in the future. Probably the 1st of April, or so.

You can find its scaffolding, held together by bailing wire and duct tape, here. Sadly, there is no program for the general public to play with, yet, just code.


The first, albeit very alpha, version of the LogCleaner is now available for download!


Instructions! Instructions! Instructions!

  • Extract the log cleaner folder to any folder and then run it by double-clicking on its icon.
  • Select File->Settings and point the viewer at your City of Heroes\logs\game folder.
    Then, File->Import logs
  • Select the logs you want to import (all of the may take a while).
  • Once that's done, you can select the dates you want to see (multiple selections are ok) and select the channels you want to see
  • Under Export Options, you can chose what is outputted when you export. The options should be self explanatory.
  • File->Export will export everything on the main table view.
  • File->Export selected will only export what you have selected

Notes:
  • The cleaner automatically tries to figure out which System entries are people doing emotes, so they are on by default (and as of now cannot be turned off). However, it can easily be confused by messages starting with a character's name. I've tried to put enough logic to ignore these, but I'm sure I didn't catch everything.
  • If you'd like to see all of the system messages, merely select the "Show System" checkbox on the right side.
  • Yes, the ability to manually tag and untag System messages as Local System/PC/Emote messages is coming
  • For performance reasons, not all of the logs are loaded at the start. You can either drag the vertical scroll bar to the bottom to load more, or click the "Load All Logs" button. It may take a few seconds for it to return, depending on the number of lines it needs to load.
  • Searching is not enabled at this time. The database structure is there and ready for it, but other parts of the program are currently taking priority.
  • I guarantee nothing about this program. I've made it reasonably well behaved and it shouldn't try to overwrite anything important. However, I haven't drunk-monkey tested it, so it might puke if given a bad chatlog (i.e. heavily modified) it doesn't understand or if you force quit it in the middle of importing.

If you have any questions or comments, please let me know!

Developer's notes: If you'd like to play with the code I have written, you'll need a free copy of QT with QTDesigner. I'm developing with Visual Studios C++ 2008 Express, but I'm pretty sure the standard minigw based QT will work, also.

Peaches
« Last Edit: April 01, 2010, 08:50:49 PM by Randompeach » Logged

In times of change learners inherit the earth while the learned find themselves beautifully equipped to deal with a world that no longer exists

Currently Reading:
Somebodies and Nobodies: Overcoming the abuse of Rank by Robert W. Fuller
The Historian by Elizabeth Kostova
Life is So Good by George Dawson and Richard Glaubman

Favorite Books:
Stranger Tides by Tim Powers
Brave New World by Aldous Huxley
Ender's Game by Orson Scott Card
Crimson Tao
Global Moderator
Blabbermouth
*****
Offline Offline

Gender: Male
Posts: 890


T'ao nar Justice vas Pinnacle


« Reply #1 on: January 25, 2010, 07:35:47 PM »

There can be only one!

/highlander
Logged

我自己掌握我的命运
Wǒ zìjǐ zhǎngwò​ wǒ de mìngyùn
I alone hold my fate in my hands

Avatars of the Tao




Randompeach
Author
****
Offline Offline

Gender: Male
Posts: 147



« Reply #2 on: January 29, 2010, 04:45:59 PM »

And here is a very very alpha screenshot of what I've got so far...
I am not very good at GUIs.... Very Happy
« Last Edit: January 29, 2010, 05:11:18 PM by Randompeach » Logged

In times of change learners inherit the earth while the learned find themselves beautifully equipped to deal with a world that no longer exists

Currently Reading:
Somebodies and Nobodies: Overcoming the abuse of Rank by Robert W. Fuller
The Historian by Elizabeth Kostova
Life is So Good by George Dawson and Richard Glaubman

Favorite Books:
Stranger Tides by Tim Powers
Brave New World by Aldous Huxley
Ender's Game by Orson Scott Card
Randompeach
Author
****
Offline Offline

Gender: Male
Posts: 147



« Reply #3 on: January 30, 2010, 10:24:51 AM »

Still not very good with UIs, but I've made a simple mockup of what the end UI probably won't be. What I have below is rather primitive, but it shows you some of the ideas I'd like to try.

Let me know what you think.

-Peaches
Logged

In times of change learners inherit the earth while the learned find themselves beautifully equipped to deal with a world that no longer exists

Currently Reading:
Somebodies and Nobodies: Overcoming the abuse of Rank by Robert W. Fuller
The Historian by Elizabeth Kostova
Life is So Good by George Dawson and Richard Glaubman

Favorite Books:
Stranger Tides by Tim Powers
Brave New World by Aldous Huxley
Ender's Game by Orson Scott Card
Randompeach
Author
****
Offline Offline

Gender: Male
Posts: 147



« Reply #4 on: February 01, 2010, 07:29:51 PM »

And another UI screenshot. However, this one is actually somewhat functional. Notice that you will be able to browse by date, channel, or character name.

Speaking of which, would anyone ever search based on NPC characters?
Logged

In times of change learners inherit the earth while the learned find themselves beautifully equipped to deal with a world that no longer exists

Currently Reading:
Somebodies and Nobodies: Overcoming the abuse of Rank by Robert W. Fuller
The Historian by Elizabeth Kostova
Life is So Good by George Dawson and Richard Glaubman

Favorite Books:
Stranger Tides by Tim Powers
Brave New World by Aldous Huxley
Ender's Game by Orson Scott Card
Crimson Tao
Global Moderator
Blabbermouth
*****
Offline Offline

Gender: Male
Posts: 890


T'ao nar Justice vas Pinnacle


« Reply #5 on: February 01, 2010, 07:37:59 PM »

... I don't see any screenshots...
Logged

我自己掌握我的命运
Wǒ zìjǐ zhǎngwò​ wǒ de mìngyùn
I alone hold my fate in my hands

Avatars of the Tao




Lady Darkswan
Author
****
Offline Offline

Gender: Female
Posts: 417


Kenobunni does cute.


WWW
« Reply #6 on: February 01, 2010, 10:06:14 PM »

They're attachments to the posts Tao.

And yeah, I could see searching by npc,  if I was rping with what the npc's were saying, or possibly rping with what the npc's were saying in an MA arc.
Logged

Randompeach
Author
****
Offline Offline

Gender: Male
Posts: 147



« Reply #7 on: February 15, 2010, 09:55:16 PM »

The Log Cleaner is almost approaching a usable state. Currently, you are able to browse through different days and channels. This reflects in the log view at the bottom.

You can toggle whether or not you see "System" messages as well as if you want to see the Rikti Monkeys beating each other senseless at Pocket D.

I have a feature planned where you are able to tell the Log Cleaner that certain entries are actually local /e messages. A bit further down the road, I plan on having some automated system guess at whether an entry is a /e message or not.

I'd love to hear any feature suggestions you have. Believe you me, it's much easier to put them in now, rather than later.

Peaches
Logged

In times of change learners inherit the earth while the learned find themselves beautifully equipped to deal with a world that no longer exists

Currently Reading:
Somebodies and Nobodies: Overcoming the abuse of Rank by Robert W. Fuller
The Historian by Elizabeth Kostova
Life is So Good by George Dawson and Richard Glaubman

Favorite Books:
Stranger Tides by Tim Powers
Brave New World by Aldous Huxley
Ender's Game by Orson Scott Card
Randompeach
Author
****
Offline Offline

Gender: Male
Posts: 147



« Reply #8 on: February 16, 2010, 07:24:39 PM »

I've implemented the ability for the Cleaner to automatically guess which System entries are /e messages.
You can see the effects in this screen shot of a Pocket D meeting.

Very Happy
Logged

In times of change learners inherit the earth while the learned find themselves beautifully equipped to deal with a world that no longer exists

Currently Reading:
Somebodies and Nobodies: Overcoming the abuse of Rank by Robert W. Fuller
The Historian by Elizabeth Kostova
Life is So Good by George Dawson and Richard Glaubman

Favorite Books:
Stranger Tides by Tim Powers
Brave New World by Aldous Huxley
Ender's Game by Orson Scott Card
435
Geth do not infiltrate.
Administrator
RPC Addict
*****
Offline Offline

Gender: Male
Posts: 1496


Geth do not -intentionally- infiltrate.


WWW
« Reply #9 on: February 17, 2010, 07:43:56 AM »

I'm curious as to the "Show Monkeys" checkbox.  Does that autoeliminate Furious BoBo and his ilk from D logs?
Logged



"This is all Joker's fault... What a tool he was.
I have to spend all day computing pi because he plugged in the Overlord!"





         
         
"I delete data like you on the way to real errors."
         
         


Crimson Tao
Global Moderator
Blabbermouth
*****
Offline Offline

Gender: Male
Posts: 890


T'ao nar Justice vas Pinnacle


« Reply #10 on: February 17, 2010, 08:08:42 AM »

Now, I can see them! (Long story, don't ask)
Logged

我自己掌握我的命运
Wǒ zìjǐ zhǎngwò​ wǒ de mìngyùn
I alone hold my fate in my hands

Avatars of the Tao




Crimson Tao
Global Moderator
Blabbermouth
*****
Offline Offline

Gender: Male
Posts: 890


T'ao nar Justice vas Pinnacle


« Reply #11 on: February 17, 2010, 08:13:02 AM »

Can you select multiple dates (i.e., I want to search for something that happened sometime last month, but don't remember the exact day?)
Logged

我自己掌握我的命运
Wǒ zìjǐ zhǎngwò​ wǒ de mìngyùn
I alone hold my fate in my hands

Avatars of the Tao




Randompeach
Author
****
Offline Offline

Gender: Male
Posts: 147



« Reply #12 on: February 17, 2010, 02:27:39 PM »

435: Yes! Yes it does! In fact, by default the monkeys are eliminated from the logs.

Tao: You can currently select multiple days without problem. You can filter the chatlogs further by selecting only the channels you're interested in. 
However, I haven't figured out a good way to do the full text search. It's probably one of the last things I'll do before the program gets into a beta form. Setting the system to do the search itself will be relatively easy, but making it usable? That's another story.
Logged

In times of change learners inherit the earth while the learned find themselves beautifully equipped to deal with a world that no longer exists

Currently Reading:
Somebodies and Nobodies: Overcoming the abuse of Rank by Robert W. Fuller
The Historian by Elizabeth Kostova
Life is So Good by George Dawson and Richard Glaubman

Favorite Books:
Stranger Tides by Tim Powers
Brave New World by Aldous Huxley
Ender's Game by Orson Scott Card
Randompeach
Author
****
Offline Offline

Gender: Male
Posts: 147



« Reply #13 on: March 08, 2010, 07:34:11 PM »

Just to keep people updated, the program is approaching my alpha feature list goal. I should have something people can play with in the next week or so!
Logged

In times of change learners inherit the earth while the learned find themselves beautifully equipped to deal with a world that no longer exists

Currently Reading:
Somebodies and Nobodies: Overcoming the abuse of Rank by Robert W. Fuller
The Historian by Elizabeth Kostova
Life is So Good by George Dawson and Richard Glaubman

Favorite Books:
Stranger Tides by Tim Powers
Brave New World by Aldous Huxley
Ender's Game by Orson Scott Card
Randompeach
Author
****
Offline Offline

Gender: Male
Posts: 147



« Reply #14 on: March 14, 2010, 09:14:19 AM »

The first, limited, alpha release of the Log Cleaner is available, now. Download links and instructions are available at the top.

Peaches
Logged

In times of change learners inherit the earth while the learned find themselves beautifully equipped to deal with a world that no longer exists

Currently Reading:
Somebodies and Nobodies: Overcoming the abuse of Rank by Robert W. Fuller
The Historian by Elizabeth Kostova
Life is So Good by George Dawson and Richard Glaubman

Favorite Books:
Stranger Tides by Tim Powers
Brave New World by Aldous Huxley
Ender's Game by Orson Scott Card
Pages: [1] Go Up Print 
« previous next »
Jump to:  

Powered by SMF 1.1.11 | SMF © 2006-2009, Simple Machines LLC Epsilon design by Bloc