Hive Report Card - Changes and Improvements

in Synergy Builders2 months ago

Firstly, and again, thank you for helping me test the hive report card! I have a lot updates!

After posting this, I will need a bit of a break. THANK YOU ALL to the overwhelming response to the tool. I really appreciate it, and can see that users like @tarazkp and @azircon each published posts on the tool, with some suggestions.

As I cannot feasibly notify everyone of the changes I have made, here is additional stuff I have implemented since I woke up about nine hours ago.

Many other people also offered ideas and suggestions. I am not a machine (but I used a few LLMs to make improvements) to the existing tool. Due to the extra features, it may run slower. I think the speed is worth it in exchange for the fixes.

Fixes:

- Even more robust searching for Cross Posts (and filtering them out)

Initially, the code was using reg-ex pattern matching to identify the permlink patterns. Now, I am also looking for posts with the same titles within the returned results, and keeping the original / one with more content. Unique perm-links with the same title should be retained.

Let me know if that is still broken.

Enhancements

- Dbuzz Posts Filtered Out

I (and the tool, and perhaps you, yes you) should not be concerned with short form content. I have filtered out Dbuzz results.

This is done by matching the literal string that appears in the footer of Dbuzz posts. I am relatively saatisifed that users won't be inserting this into their own material:

if (c.body && c.body.includes('Posted via <a href="https://d.buzz" data-link="promote-link">D.Buzz</a>')) continue;

- Chart Zoom

You can now zoom into charts! Look at more resolution!

image.png

- Chart Gaps

Data was rendering with the next data point, no matter the length of time between those data points. Now there should be gaps and flat spots on charts to represent breaks.

image.png

- Busy Charts

What about trends for Weeks, Months and Years? This is now implemented.

image.png

- Emotes!

I have added emotes to the cards to help them be a little bit more visually distinct from one another.

Still on the List:

- Table Showing Break Periods as a List

So, you've had one break, but what about second break? Currently, the tool only identifies the longest break you've had from HIVE. I want to make sure there's a list of at least 5 breaks and 5 streaks with the dates to identify periods of activity and inactivity.

- Table of Trends Over Periods

I think I need to ask @azircon some more questions about what they meant by this, if you could provide me with a small mock up of what you want? Even if you draw it on paper ;) I would be grateful, as this is something I can work on for a future version.

- Set User Time Zone

Another request from @azircon - This is something that I haven't looked at all yet.

Known Issues for Further Investigation

- Word Count

Word count is inconsistent. This leads to issues with the calculation of the readability score.

- Image Count

Some users have reported that images are under-represented, over-represented, and all over the place. This is something that will require further investigation.

- Zooming Charts is Slow with large data sets

My initial response is "deal with it, big data is big slow", but I will look into it.

Thank You

I will continue working on improvements on this tool until I am happy with it. I have high standards.

As it gains complexity, the addition of new features becomes slower, because that is the way with one-man technical projects.

New Version Here

Thank you also to those who have decided to support my witness as a result of this tool. If you haven't already, you can do that here: https://vote.hive.uno/@holoz0r

I'm off to rest for a bit and write a bit of creative stuff instead of trying to fix code and find solutions!

Sort:  

Greetings @holoz0r ,

Appreciate your work and dedication to Hive.....this is an amazing tool indeed.

It is rather like looking in the mirror.... ^__^

Thank you for the engagement readings...so appreciate it.

Kind Regards, Bleujay

No problem! I have some small ideas left to implement, and then need to clean the code up thoroughly. A perfectionist is never done.

I was just checking it out. It's interesting that my Britlist posts come up as professional, but then they are a lot of stats. I had some elementary ones a while back that were mostly about my running. Maybe my quality has improved recently.

I love all the stats we can get from Hive. I have done my own experiments with HiveSQL, but I doubt I will be creating a site for those as that's beyond my skills. I'm grateful to you and others who can do this.

!BEER

Thanks mate, this is far, far from perfect, but there will be improvements as I go. This one pulls data from hive api end points and does all the processing on your machine, so a bit different to HiveSQL.

I wrote logic in python then converted it to javascript using various llms, because I don't know js, but I am finding myself forced to learn. :D

I saw the same kind of thing with some of my posts - it seems that if a post has a lot of internal links to other Hive posts it is more likely to come up as Professional. Perhaps the reading score interprets lots of links as identifying sources, further reading etc. 😁 But for me as a non-techie person, it's still one of the best tools I've seen on Hive in terms of delivering data in an easily visualised user friendly format.

I think i have eliminated that issue, but only further testing will confirm.

So detailed and an amazing app. I used it and was awed. I'll share my thoughts.

Be sure to tag me when you do, please!

Hi! I tagged you on my post

I had a play and wrote a shit review, out soon. I voted your witness for many reasons but you know data ain't one 🤔😎😘

Thank you, I look forward to reading it.

I have voted for you even before this tool, but this tool is great. For me the most interesting chart was this one:

It appears that engagement steadily declines as my writing goes beyond High School level. Given that most of my writing is at College level it sure seems that I need to lower my writing level...

Not "lower" the level, just increase the readability :) Cant still discuss lots of complicated ideas in language that is easy to understand.

In a former job, I needed to simplify work instructions and process docs so our International staff with non native English mastery could read them quicker.

I used this method to simplify the documents without simplifying the content. :)

Involved a lot of writing and editing for clarity, though.

Well, I just write how I think I guess... and btw, English is not even my second language. My first was Russian, second was Ukrainian and then I learned English and German, though German I mostly forgot by now.

I really respect polyglots! I can't fit all that stuff in my head

I used this method to simplify the documents without simplifying the content

This is key.

I wouldnt worry about readability much. It's only one to to assess a post and to be fair it doesn't really give the full picture at all in my humble opinion!

It's looking awesome already! it's so cool that you made it happen!

I have more improvements to release today :D

I feel like I now have the tool in a "feature complete" state, and it shouldn't need any further changes at this point. :D

Are you sure? Because than you could go on to new horizons, take on a new challenge and see if you can find the data that I mentioned... :-P

Check your discord DMs

Late to see the update, but here I am. Just to confirm that your project is fantastic, and I'm planning to write a post doing a self-analysis of my profile with your system. Thanks again for your dedication in doing it! In fact, I've already updated my vote for you as a witness!

Thank you so much. I look forward to see what you get out of it, be sure to tag me in your post!

It's a very cool tool, so thank you!

On a different note, I see people love to show off their results. Just read a post, the guy highlighted his excellent performance, having university and post graduate level posts, while he's been caught using AI countless times.

Ha, Whoops. If I could (without using AI) determine if content was likely to be AI, using this tool, I would, but I do not know how that would be possible. Research perhaps for another day, or maybe that would be worthy of DHF funding.

The irony being, a lot of the code for this tool was translated from my rough python psuedo code into JS using a few different LLMs.

JS and Python aren't all that different, but I am spending the day today fixing silly and stupid logic in a bid to make the tool run faster, so it can scale as the scope and quantity of content changes.

I am ever a delusional optimist about the future of hive being its human generated content.

It wasn't a complaint as I know filtering out AI generated posts is borderline impossible. I was just mentioning how stupid people are. I haven't checked the stats of the master of tasks, most likely I'd see all academic level posts as we know how they operate. Anyway, it's just for fun as hive should be about having some fun and not writing dissertations each day. I suppose just as with reputation (which we know some got theirs using bidbots), everything here has to be taken with a pinch of salt.

Absolutely - by pinch of salt, I think you might mean those enormous mining trucks that need a ladder and hard hat to climb.

I am a data driven individual, and I am also a creative individual. I remember when I discovered the Flesch Kincaid measure in primary school, I was fascinated by how writing can be broken down using analysis.

The response from many writers to this tool on HIVE has already been incredibly positive, and that alone has made the time I've spent on it so worth it.

I have another use case for it, in which it might be able to give a hint at how an individual user is engaging on the chain, or we might be able to input a list of user names (once I fix all the bugs) to see how, perhaps; a group of newly created accounts have "performed" in terms of generating engagement in response to their content, and what sort of content tends to generate success.

This is all in an ideal world, however.

In shorter terms, for projects who claim to onboard "quality" users to Hive, I want to have (another) version of this tool that can iterate through users and then allow people to make educated decisions about how they vote for witnesses and how they direct their DHF funding.

Big picture, longer term stuff, which I have only thought of in my rambling reply to your reply.

I remain ever-delusional and ambitious.

I do, however, value your input - what is a feature that you would like to see - be it in the existing tool, or future versions?

Absolutely - by pinch of salt, I think you might mean those enormous mining trucks that need a ladder and hard hat to climb.

Exactly! Taking everything with face value is not the best thing and we know it. New users don't, but that's not so important right now. Veterans know how things work here.

I am also a data driven person as data is my life, I can't work without data, so I understand you perfectly.

I have an idea for you, but I'd rather send you the details privately as it's better. Actually I have more than one idea, so drafting a list and will contact you on Discord shortly 😎😂

No problem, I look forward to your message. I have the same username on discord. I lurk as invisible, so send a friend request, and send a message :)