r - Generating large adjacency matrix -


i'm trying generate adjacency matrix csv.

the csv contains 2 columns, 1 users , 1 projects. 2 columns form bipartite graph, each user can part of multiple projects or none @ all, no edges between nodes of same set (there no repeating entries same user-project pair, there repeated entries of same user or projects different combinations pairs).

i wrote comparison comparing each user's project entire project set using matlab , ismember(a,b). algorithm runs iteratively through each entry. in end, have adjacency matrix of size m(|users| + |user|) x (|users| + |user|).

for small entry count < 15000, works fast, sample of +15000, matlab stalls. initialize adjacency matrix zeros matrix (zero(r,c)) , add row row results of ismember(a,b). matlab, zeros matrix zero(15000,15000) maxes out memory. tried making 0 matrix in r size (matrix(0, 15000, 15000)) , maxes out r's memory.

is there way around this? full sample size 597,000 rows (with ~70,000 users , ~35,000 projects) , want run network analysis of it.

also want keep in matrix format , not adjacency list because have max cut min flow algorithm want run on results , works matrices.

updated:

the data looks 

 user  |  project 382       2429 385       2838 294       2502 ...       ...

it taken sourceforge using zerlot university of notredame. each int value key in sql database. want convert affiliation data one-mode user-to-user adjacency matrix each edge between users shared project.


Comments

Post a Comment

Popular posts from this blog

angularjs - ADAL JS Angular- WebAPI add a new role claim to the token -

i have created angular spa webapi backend using adal js authentication.as there no roles in ad, need manually add role claims in order give users access different api controllers. the roles stored in database. expecting inject claim through call webapi after authentication ad. webapi code might this. identity.addclaim(new claim("role", "user")); var ticket = new authenticationticket(identity, props); var accesstoken = startup.oauthbeareroptions.accesstokenformat.protect(ticket); is possible replace adal idtoken new token? is viable solution or there other better way handle this? as initial token generated azuread, possible edit token add new claim? appreciated. graph api supporting group claims. see here: http://justazure.com/azure-active-directory-part-4-group-claims/ if @ examples on page, users assigned groups , app can check group in claims. in current version of portal, need app manifest , modify it.
Read more

node.js - Using Node without global install -

i'm working on few node & electron (atom shell) projects , i'm curious how them work without user having install node globally. i've seen few applications including node directory in project contains node.exe binary. how go setting node project use binary? edit: thought should add, i've searched everywhere answer this, unrelated results.
Read more

php - CakePHP HttpSockets send array of paramms -

i problem when make request (i can request). $link = 'http://uri/path/?param1=1&sid=2&sid=3&sid=4' $http = $httpsocket = new httpsocket(); $res = $httpsocket->get($link); if check request pr($http); i see : [line] => /url/path/?param1=1&sid%5b0%5d=2&sid%5b1%5d=3&sid%5b2%5d=4 http/1.1 and i'm getting empty response because server doesn't know parameters sid%5b0%5d=2 when try send parameters array : $data = array('param1' => '1', 'sid' => array('2','3', '4')); i see same changes %5b0%5d - additional indexes. how fix it? unfortunately , can not change server side, if send request in browser, i'll normal response in json format. when make request, can parameters this: $param1 = $_get['param1']; $sid= $_get['sid']; tip: use diferente names parameters. have multiples sid. use sid1, sid2, sid3... update: can parameters this:...
Read more