Page 1 of 1

Dubs forum RSS feed?

Posted: Mon Apr 05, 2010 5:16 am
by nog_lorp
It would be cool to have a list of recent new threads in the Dubs forum, or possibly just soundcloud/youtube/audio links. If it were as simple as going through an RSS feed, it would be way easier to listen through them, which would really be a boon for artists.

For my own listening purposes, I've written a perl script to crawl the day's threads in Dubs and grab any SoundCloud links, and a bookmarklet for TheCloudPlayer.com to add a list of song ids to a series of playlists (limited at 40 songs per playlist unfortunately). This isn't a very accessible approach, but it would be pretty straightforward to use the SoundCloud API to read a feed of links and run a playlist of them.

It would be worthwhile to implement a phpBB module to do this, and integrate a player to the side of a forum, or have soundcloud play bars appear in the forum (and have continuous play).

Anyone receptive to this idea?

Re: Dubs forum RSS feed?

Posted: Mon Apr 05, 2010 7:45 am
by mickledan
this a fucking good idea.

site is slow as hell sometimes, RSS feed wouldn't detract from the number of visits, if anything it would lead to more as people will be given direct access to interesting threads / dubs / mixes.

+1 :z:

Re: Dubs forum RSS feed?

Posted: Mon Apr 05, 2010 9:27 am
by nog_lorp
If people are interested, I can start running my slurp script and distributing those playlists. At the moment, a lot of older stuff gets in because I'm not checking the date of the thread, and I can't seem to stop the WWW::Robot perl module to limit its depth.

Here's the playlists I've made so far: I think soon I'll make something to download all downloadable tracks, and start carrying the newest dubstep of the moment on my iPod.

If you're interested, heres the script and bookmarklet I'm using now:

Code: Select all

/* add a list of song ids as a bunch of playlists (split at 40 songs) */
p.hacklinks;
p.hackinc;

function initAddTracks() {
   p.hacklinks = $('#freshdub-links')[0].value.split("\n").filter(function(val) { return (val) });
   p.hackinc = 0;
   addTracks();
}
function addTracks() {
   addPlaylist($('#freshdub-listprefix')[0].value);
   addTrackList(p.hacklinks.splice(0, 40));
}

function addPlaylist(name) {
   var pos = $("#playlists li:not(.dont-persist)").index($("#playlists li:not(.dont-persist):last"))+1;
   $.post("/playlists",{'name': "[" + p.hackinc++ + "]" +name,'position': pos},function(data) {
      var item = eval('(' + data + ')');
      p.playlists[item.playlist.id] = new SC.Playlist(item, p);
      p.switchPlaylist(item.playlist.id);
      $("#playlists li:last a:first").click();
   });
}

function addTrackList(list) {
   $.ajax({
      url: "http://api.soundcloud.com/tracks.js?callback=?&ids=" + list.join(),
      success: function(data) {
         /*p.selectedPlaylist.limit = list.length;*/
         setTimeout(function() { 
            for (track in data) p.selectedPlaylist.addTrack(data[track]);
               p.selectedPlaylist.save();
            if (p.hacklinks.length > 0) addTracks();
         }, 1000);
      },
      dataType: "json",
      /*error: function() { alert("ERR");}*/
   });
}

if ($('#freshdub-popup').length > 0)
   $('#freshdub-popup').fadeIn();
else
   $('body')
   .append(
      "<div id='freshdub-popup' style='position:absolute; display:block; top:25%; left:25%; width:400px; height:200px; border:2px dotted white;'>" +
      "   <div style='float: left; width: 100%; height: 100%; background-color:rgb(128, 128, 255); opacity:0.4; border: 2px dotted black'></div>" +
      "   <div style='position:absolute; width: 100%; height: 100%; text-align:center; vertical-align: middle; display: table-cell; border: 1px solid rgb(80,60,180);'><br />"+
      "      <textarea style='width: 80%;' rows='6' id='freshdub-links'></textarea><br />" +
      "      <div style='width: 80%; margin-left: auto; margin-right: auto;'>" +
      "         <button style='float: left' onclick=\"$('#freshdub-popup').fadeOut(); initAddTracks(); \">Add</button>" +
      "         <input style='float: right' size='35' id='freshdub-listprefix' type='text' value='FreshestDubs"+(new Date()).toLocaleDateString()+"'></input><br />" +
      "         <button style='float: left' onclick=\"p.selectedPlaylist.limit=$('#freshdub-limit')[0].value; p.selectedPlaylist.load();\">Resize Selected Playlist</button>" +
      "         <input style='float: right' size='5' id='freshdub-limit' type='text' value='100'></input>" +
      "         <button style='position: absolute; top: 0px; right: 0px;' onclick=\"$('#freshdub-popup').fadeOut();\">x</button>" +
      "      </div>" +
      "   </div>" +
      "</div>");
A handy bookmarklet to dump playlist links:

Code: Select all

/* give a list of share urls for all your playlists on thecloudeplayer.com */
 var myShareUrls = new Array(); $('.share').map(function (i, dom) { myShareUrls.push(dom.href); });
 alert(myShareUrls);
 
I don't really want to hand out the crawler, it crawls a fair amount more pages than it needs too right now, and no point in getting multiple people crawling the same thing and wasting bandwidth.

Here's what I crawled earlier today though:

Code: Select all

2235965
2145538
1892715
1396146
2285097
1788908
1693529
2169868
2158968
1900567
1427625
534804
1674578
2258753
2281388
793043
1706648
1910068
1617069
2143282
1775333
1217155
1987837
2174448
2245496
1675689
2271281
2184003
2266854
2283376
1771707
2120231
2038302
2134727
2134525
2135088
2277187
1676010
2008832
1875530
2132977
2144276
2264250
2242640
1731457
2282155
2281225
2278345
1074946
1993720
2221624
1753710
2228474
1756406
2129914
2241705
2214128
2024250
2071652
2084945
557199
1962360
1804590
2228005
1679844
2270550
1174912
681689
1114240
2285382
1971509
1495026
1504184
2264293
2066036
2251950
1856086
1795705
1926851
1653614
1906299
1807221
1190423
1191061
2271078
2286181
112194
1162646
815275
1806527
1779584
2053806
1472322
2280667
2245405
2270370
2287122
2286984
1899796
2281698
2072167
2287181
2288545
2254088
2085204
Anyways, if admins are down, I'd be willing to work on a phpBB module.

Re: Dubs forum RSS feed?

Posted: Mon Apr 05, 2010 11:30 am
by cixxxj
Oh yes please do it!!!

Re: Dubs forum RSS feed?

Posted: Wed Sep 28, 2011 7:46 pm
by nog_lorp
Bump! A long time has passed. Any admins wanna comment on if they would install a mod for this?

There is probably already something that serves this purpose, but I'll develop it if necessary.

Re: Dubs forum RSS feed?

Posted: Wed Sep 28, 2011 7:55 pm
by DJSpekt
lets get this going!! this is a fantastic idea and why it hasnt been done yet blows my mind

Re: Dubs forum RSS feed?

Posted: Wed Sep 28, 2011 8:01 pm
by Teknicyde
nog_lorp wrote:Bump! A long time has passed. Any admins wanna comment on if they would install a mod for this?

There is probably already something that serves this purpose, but I'll develop it if necessary.
Dont hold your breathe, dubway has been adamant about not wanting to install any un-nessasary plugins already, hence why we use the phpbb default skins, ect. around here.

If nothing else, the first hurdle would be that only logged in, registered forum members have access to the dubs forum, and from what I understand, they have reasoning behind this.

Re: Dubs forum RSS feed?

Posted: Thu Sep 29, 2011 8:42 am
by nog_lorp
Teknicyde wrote:If nothing else, the first hurdle would be that only logged in, registered forum members have access to the dubs forum, and from what I understand, they have reasoning behind this.
Madness!

Re: Dubs forum RSS feed?

Posted: Thu Sep 29, 2011 11:53 am
by Teknicyde
nog_lorp wrote:
Teknicyde wrote:If nothing else, the first hurdle would be that only logged in, registered forum members have access to the dubs forum, and from what I understand, they have reasoning behind this.
Madness!
'
lol I agree to this 100% and I had a chat with a couple mods Ill leave un-named about having them post about it in there super-secret-mods-only-board, but in the end, like I said, guess theres a reason behind it.

I feel like if the dubs board was public, I could link more friends and non-forum-member listeners to my threads, drive traffic to dsf, and maybe spur some new people into joining aside from the... typical people who've been joining lately.

Re: Dubs forum RSS feed?

Posted: Thu Sep 29, 2011 6:24 pm
by seckle
nog_lorp wrote:It would be cool to have a list of recent new threads in the Dubs forum, or possibly just soundcloud/youtube/audio links. If it were as simple as going through an RSS feed, it would be way easier to listen through them, which would really be a boon for artists.

For my own listening purposes, I've written a perl script to crawl the day's threads in Dubs and grab any SoundCloud links, and a bookmarklet for TheCloudPlayer.com to add a list of song ids to a series of playlists (limited at 40 songs per playlist unfortunately). This isn't a very accessible approach, but it would be pretty straightforward to use the SoundCloud API to read a feed of links and run a playlist of them.

It would be worthwhile to implement a phpBB module to do this, and integrate a player to the side of a forum, or have soundcloud play bars appear in the forum (and have continuous play).

Anyone receptive to this idea?
The whole idea of "playlists" means that one person is recommending a set of producers to everyone else. This is totally not the experience we wanted to highlight when the dubs forum started out. We don't want anyone's personal preferences or tastes involved with the purpose of the dubs forum, and adding scripts and mod's to it, change it into something akin to last.fm/pandora. Those sites do that stuff well, but thats not something we want to encourage whatsoever. I understand that everyone wants everything immediately and databased immediately as a one-click musical experience as per the mp3 world we live in. However, the fact of the matter is that the dubs forum from our vision, was like a room full of vinyl. crate digging culture, where there's only rewards for those that take part, and spend the time digging. if everything is playlisted, and rss'ed, that's not helping new producers at all, because by default a popular playlist is a hierarchy, and dozens of new producers will get marginalized in the process. we don't want to play into popularity contests, and rss'ing and playlisting is all part of a popularity game with music on the internet now. some of the biggest names in this sound today started out putting dubs in links here, and they didn't need RSS'ing or playlisting to get their music heard.

there are ongoing discussions about how to classify the dubs forum into a structure, but as with everything on DSF, we don't make rush decisions.