The tutorials i found online, teach me how to register users emails into my Mailchimp. but what if i already have those emails stored in the database and only want to transfer them? is it possible?
You want to export the mongodb database to a CSV file.
I did the exact same thing a while ago and unfortunately I can't find the code I used, but it was pretty simple. You want to use this approach: https://stackoverflow.com/a/18302533/183904
Related
Does anyone know a web crawler tool for collecting contact details from a website? Say I have a www.website/contact.. I want to pull out the address, phone number, etc.. There are 2 tools I've been looking at: cralwer4j opensource jar for java and Scrapy opensource in Python. But I am finding it a bit hard to use for my scenario.
Any suggestions would be great. Thanks
You might google for "simple web crawler" to find a solution that fits you best. In the net there are plenty "pure python" based web crawlers. Based on sceleton code you add db wrap up. I think the most problem would be db setting and saving data in it.
What if there are 1000000s of websites to crawl.. Is there a way to crawl all websites in my are?
No problem for scripting. Just put millions addresses in a file (or files), open it for reading in python or other script. Then get link by link from it and crawl/scrape to your pleasure. Result you might also want to save in file (csv, json).
I'd also recommend you a ready simple python crawler.
currently I am writing a Windows 8 App with Sqlite as a database. I want to give the user the ability to view his data in every instance of the app on any device. Usually this problem could be easily solved by using a online database like Windows Azure. But this is not an option in my case.
Is it a good idea to use Microsoft's free service "Skydrive" as a platform to synchronize database files among several devices? Does somebody know any open source projects or blogs that are dealing with this problem that could save me some time for writing the necessary code?
If it's a bad idea, which other options are there that I could use. I want to keep Sqlite as the database for my App.
I am glad to get any kind of feedback or links to resources that might help me.
Best regards
Philipp
imo it isn't a good idea cause the access to db files is to easy. Ofc you can say that access to database files is easy cause you need to just know the app data path to package of your app but still it`s much more difficult than just opening skydrive. And think what would happen if someone would make this directory on skydrive as public.
I would combine local db and online db. Online db as a service for synchronizing data and local db for normal work.
Someone at my office asked me to build a browser tool to let them specify a database table's columns and then let them edit the rows. I would be happy to do that, but it seems like this must have been written before or is part of some CMS tool out there. Is there a tool/service/website that lets user create simple database schemas that can then be editted? I am looking for a very simple tool. That really amounts to a simple table editor. It doesn't need to know about foreign keys or indexes. Something like multiple people editing a spreadsheet on Google docs but only let users edit one row at a time.
Extra points for an ASP.NET/MVC tool.
I'm not sure if it is what you looking for but have a look at phpMyAdmin.
It is a tool for mySql to manage databases, table, user, and data of a mySql installation.
It is a php written webfrontend.
http://www.phpmyadmin.net/home_page/index.php
This may be overkill for your needs, but we use DbVisualizer to manipulate our databases.
I have made a tutorial that shows you how to install phpMyAdmin on your server. The designer mode makes it simple to manage your database and it runs in your browser. This tutorial shows you how http://havenofcode.com/tutorial.php?tut=9.
I would like to build a Shared Documents Library in ASP .Net and SQL Server but I have a problem, the customer wants to open the documents (stored in SQL Server) in Office UI and when save it, the document should be saved directly in database like SharePoint Server.
I've been researched on web since last week and I didn't found any answer or specific technology to do this.
Do you have any idea?
Thanks,
Sergio
I believe it would be best to store the information within the documents or perhaps the file paths rather than the documents themselves. None the less, it is possible to achieve what you wish to accomplish.
In your ASP.NET site, you will need to add a functionality to import/export some MS Office documents.
Solution 1
The site could allow a user to upload a document in a folder on the server and the site could store the file path in the database. For the download part, you could simply select the proper file path so that the user can download the document he/she wishes.
Solution 2
The site could allow a user to upload a document and store it in the SQL Server database. The documents could be stored as BLOBs. In SQL Server, you can use the varbinary(max) datatype for that. It would be rather tricky for the download part...
Here are some sites to help you out:
http://support.microsoft.com/default.aspx?scid=kb;en-us;258038
http://www.sqlservercentral.com/forums/shwmessage.aspx?forumid=169&messageid=243427
http://weblogs.sqlteam.com/peterl/archive/2007/09/26/Insert-binary-data-like-images-into-SQL-Server-without-front-end.aspx
SharePoint provides a WebDAV interface to update its files. Now, it may be a hefty bite to chew, but if you were to develop a WebDAV interface, that could be the ticket.
Take a look at this article, where something similar is described. Perhaps it will help you get started.
http://thehojusaram.blogspot.com/2007/06/c-webdav-server-with-sql-backend-source.html
I don't know of any tools to do this, but I see two possibilities:
1) Save a pointer to the file in the DB instead of in the DB itself. I think this is closer to what Sharepoint actually does, but I could be wrong, there.
2) Store the document as OpenXML (in an Xml datacolumn). Then, using Office Interop, open the Word (or whatever) and pass it the OpenXML data to generate the actual document. When the user clicks 'save' save it back to the DB as OpenXML.
------ Bonus Idea ------
3) (For small enough files) You could also use NVARCHAR(MAX) fields in your DB to store the data, if necessary, though storing the formatting information can be a little difficult.
So Google Analytics does not have an API that we can use to get our data, so is there an efficient way to programaticly fetch the data collected by Google, without logging it locally?
Edit:
I would prefer a Python or PHP solution but anything will work.
Google just announced that they're making available a data export API for Google Analytics. It sounds like that's exactly what you're looking for.
Per their announcement, the feature's currently in private beta, but I figure it'll be rolled out to all accounts in coming weeks/months. Depending on your needs, you may just want to wait, instead of building a short-term hackish solution.
If you're interested, I presume that the functionality's being rolled out first to members of the Google Analytics Trusted Tester program.
Also, I forgot about this: I never actually completely implemented this for a client because the deal fell through...
But you can customize the dashboard to include the sections of Google Analytics that your report might need and have a scheduled email. If the reports do not need to be too detailed and if Google already aggregates the data in the way you need it, then this might work for you.
The Google Analytics API is now open to everyone and looks like it contains the full data set
Well, it depends on what you want to do with the data. If you only want to process part of it, then I don't think it is difficult.
Here's a basic web search with a hit explanations from Google and someone else:
http://www.google.com/support/analytics/bin/answer.py?hl=en&answer=55561
http://blogoscoped.com/archive/2008-01-17-n73.html
There is a completely programmatic way to access the data using greqo(PHP), but the analytics class is in beta. Check it out here.
If beta is not acceptable, you can use a mixture of the XML and Yahoo Pipes to get what you need.
Basic Method
Obtain the tracking data in a usable
format – We can schedule Google
Analytics to email this as an XML file
on a regular basis.
Make the XML file accessible online –
By emailing an attachment to Google
Groups, the file is automatically
given a public URL.
Work out the URL of the most recent
report – Since Google Groups provides
RSS/Atom feeds for all messages, we
can easily find the URL of the most
recent message and therefore work out
the URL of the XML report.
Prepare the data for use – We need to
manipulate the XML and massage it into
a handy JSON format that we can use on
our blog, which can all be done using
Yahoo Pipes.
Taken from here.
I implemented a solution where we scheduled the analytics report to be emailed to a gmail account each day and I pulled the report on demand via POP3. It's pretty easy and works fast. I've heard Epic1 will do this for you as well. I'm researching that now.
If you're using Python, Pandas io is also very helpful. Pandas has an interface on top of the Google Analytics API. It's pretty simple to get up and running and integrates with Pandas so you get the aggregation, time series features, and other data analysis library features.
instructions on how to authenticate and shows examples: http://blog.yhathq.com/posts/pandas-google-analytics.html
more examples: http://quantabee.wordpress.com/2012/12/17/google-analytics-pandas/
I've also posted a few queries to get started
https://github.com/sk8asd123/ga_pandas
Its been a while since I had to deal with this, but Google Analytics has an XML output type, so you can parse that to get the data in your own system. However, I believe that there is no way to get the xml file programatically, so someone still has to go in and generate the file and feed it to your app.
Good question though, I'd love to see if there is a 100% automated solution.
We just released a product - Megalytic - that makes it very easy to create custom reports using data from the Google Analytics API. You can email these reports to others without sharing your Google Analytics account. Also, create links to reports, download as PDF, etc.