had not coded in spark for a lot while, specifically in pyspark, 

since i decided to use spark to generate neural network's sample/ data set, needed to install spark.

not interested to run from docker etc this time.

actually missed running program directly without docker. 

even had not defined any conda environments.  i mean just using the main environment there with no kind of special environment definition for project or makefile.

I only need to generate sample data and thats it and being lazy to create specific python environment and even lazy to use the main conda environment to install libraries. normally its better to define specific environment for project and have some makefile that makes it active right? but i am lazy right now and dont want to do spare time to makefile or conda environment specialization for this project component of sample data generation task. 

---------------


hmm tried to install spark to windows and pyspark conda has had some errors, then installed to linux/wsl and now seems as working yayy. but lotst many hours whilst trying to solve spark probilem on windows (environment variables seemed to be correct,  have no idea why it did not worked) but nice finally pyspark working with wsl's spark. hmm also needed to install x server to communicate with desktop applications.


Yorumlar

Yorum Gönder

Bu blogdaki popüler yayınlar

 i am already bored of quantum jump meditation i just had a instant idea on sunday to test this.  but tested once and it does not work.  and its boring imho to have repeat.  I mean dreaming of Star Trek spaceships alike spaceship etc in quantum jump meditation.  I think my instant want to test this topic for being scared of ww3 risks and reading very scary such news of ww3 flash points in world,  turned out i dont have skill to quantum jump maybe somepeople can. I mean my pdf region in tihs is yet 1/52 like pdf region. not much. 
Devamı
 some weird incident report: I were vacuum cleaning living room section of flat.  Then, I were in vicinity of also light switch of living room flat light. But Up to my knowledge either my arms had not any moved to that region nor vacuum cleansing accesories. (altough only 99,9999999% be sure on this but I checkedthat span of my movements do not enter to light switch's volumetric space even if i were in very vicinity of light switch. though not in directly near to light switch to either)  Then a moment I am vacuum cleaning the table/desk region there,  the light switched on. I got shocked. to see to check what happent. to see that light switch has been switched on.  -> opinions: possibility A: - imho even 0.000000001 probability sokmehow the accesories of the vacuum cleaning (its tube moved there) altoguyh I checked that this is not very posisble. but one can never be sure. of that 0.0000001 possibility. possibility B:  - or else aliens or future centurie...
Devamı
( some time, the mafia infestations articulated by unknown mafia infestation tribe of ferikoy attempted pattern of very very deplorable/disgusting/despicable batteries along with false flag/fab ops. )(this time a~ga smear literal passing fab ops/false flag to smear like that, complete inverse psychology type pure fab ops false flag including battery) (the rodents of mafia infestation, needless to state, of course failed at their very disgusting very severely despicable criminal attempts alike all incident patterns/attempts of such disgusting rodents of mafia infestation) the despicable mafia infestation rodent later also in false flag/fab ops shouted love. Articulated mafia rodents also do attempt such incident pattern in their despicable deplorable false flags/fab ops/very very despicable deplorable batteries.  'arsenal of freedom' titled project of ml algos is work in progress to be finished soon (which would along developing many projects would also in 2 very important proje...
Devamı