Scripts et taches planifiees » Historique » Version 36
Florent Torregrosa, 04/08/2013 19:53
code after test of d7-all-dump-individual.sh manual doesn't work
1 | 1 | Julien Enselme | Afin de gagner du temps et d'éviter les erreurs humaines, des scripts ont été écrits tout au long du projet. Certains sont même exécutés automatiquement toutes les semaines. |
---|---|---|---|
2 | |||
3 | 13 | Florent Torregrosa | {{>toc}} |
4 | 1 | Julien Enselme | |
5 | h1. Les tâches planifiées |
||
6 | |||
7 | 26 | Florent Torregrosa | h2. Crontab |
8 | |||
9 | 3 | Julien Enselme | Pour exécuter ces tâches régulièrement, on utilise le "crontab":http://fr.wikipedia.org/wiki/Crontab. Il s'agit d'un programme installé sur notre serveur. |
10 | 1 | Julien Enselme | |
11 | 3 | Julien Enselme | Pour voir et modifier la liste des actions : |
12 | # se connecter au serveur : <code>ssh assos@sas1.centrale-marseille</code> |
||
13 | # taper la commande pour voir le crontab <code>crontab -l</code> |
||
14 | # taper la commande pour modifier le crontab <code>crontab -e</code>. /!\ Ne pas effectuer cette opération avant de s'être renseigné sur "vi":http://fr.wikipedia.org/wiki/Vi (l'éditeur de texte utilisé qui n'est pas vraiment intuitif :p) et sur "la syntaxe du crontab":http://fr.wikipedia.org/wiki/Crontab#Modification ! |
||
15 | |||
16 | 24 | Florent Torregrosa | {{tip(Pour utiliser un autre editeur que vi taper : export EDITOR=editor_name exemple : vim, nano)}} |
17 | 26 | Florent Torregrosa | |
18 | <pre> |
||
19 | <code class="php"> |
||
20 | Ici bientôt le crontab |
||
21 | </code> |
||
22 | </pre> |
||
23 | |||
24 | 1 | Julien Enselme | Voici la liste des tâches effectuées régulièrement. |
25 | |||
26 | 25 | Florent Torregrosa | h2. La réinitialisation des variables |
27 | 1 | Julien Enselme | |
28 | 25 | Florent Torregrosa | Cette tâche consiste à réinitialiser certaines variables qui donnent des droits considérés comme trop permissifs donc dangereux aux administrateurs des sites ou nécessaire pour d'autres scripts tels que piwik ou security_review. |
29 | 3 | Julien Enselme | |
30 | 25 | Florent Torregrosa | En voici quelques exemples : |
31 | |||
32 | 1 | Julien Enselme | <pre> |
33 | <code class="bash"> |
||
34 | 25 | Florent Torregrosa | drush -y vset error_level 0 |
35 | 1 | Julien Enselme | </code> |
36 | </pre> |
||
37 | |||
38 | 25 | Florent Torregrosa | Cette commande permet de ne pas afficher les messages d'erreurs. En effet, ils contiennent parfois des informations sensibles sur l'installation et ne doivent donc pas être divulgués à n'importe qui. |
39 | |||
40 | 1 | Julien Enselme | <pre> |
41 | 21 | Florent Torregrosa | <code class="php"> |
42 | 25 | Florent Torregrosa | drush -y vset --always-set reverse_proxy TRUE |
43 | drush -y vset --always-set --format=json reverse_proxy_addresses '["147.94.19.16","147.94.19.17"]' |
||
44 | 3 | Julien Enselme | </code> |
45 | 1 | Julien Enselme | </pre> |
46 | |||
47 | 25 | Florent Torregrosa | Ces commandes permettent de déclarer à Drupal les serveurs proxy du CRI afin d'éviter qu'il ne répertorie tous les visiteurs comme ayant l'adresse des serveurs sus-cités. **Pas fini : voir http://assos.centrale-marseille.fr/content/t%C3%A2che/d%C3%A9clarer-les-proxy-du-cri-%C3%A0-drupal** |
48 | 1 | Julien Enselme | |
49 | 3 | Julien Enselme | h2. La sauvegarde des bases de données |
50 | 1 | Julien Enselme | |
51 | 3 | Julien Enselme | Sur les installations d6 et d7 : une fois par semaine |
52 | 1 | Julien Enselme | |
53 | 6 | Julien Enselme | On utilise les [[Scripts_et_taches_planifiees#Tout-sauvegarder|scripts de sauvegarde créés par le club Drupal]]. |
54 | 1 | Julien Enselme | |
55 | 3 | Julien Enselme | h2. La purge des sauvegardes de bdd |
56 | 1 | Julien Enselme | |
57 | 3 | Julien Enselme | Sur les installations d6 et d7 : toutes les semaines |
58 | 1 | Julien Enselme | |
59 | 3 | Julien Enselme | Cette tâche utilise le script de [[Scripts_et_taches_planifiees#purge_des_sauvegardes.sh|purge des sauvegardes]] afin de libérer de l'espace disque en supprimant les sauvegardes de bdd les plus vieilles. |
60 | 1 | Julien Enselme | |
61 | h1. Liste des scripts à disposition |
||
62 | |||
63 | Les scripts utilisés sont hébergés dans le répertoire bin du compte assos. |
||
64 | |||
65 | h2. all-reset-permissions.sh |
||
66 | 21 | Florent Torregrosa | |
67 | <pre> |
||
68 | <code class="php"> |
||
69 | #!/bin/sh |
||
70 | |||
71 | . scripts-config.sh |
||
72 | |||
73 | # This script puts the correct permissions to sites folders, settings.php and scripts. |
||
74 | |||
75 | ######### drupal 6 |
||
76 | for dir in `find $d6_dir_sites -type d -maxdepth 1 -mindepth 1 ! -name all ! -name images ! -name languages` ; do |
||
77 | chmod 755 $dir |
||
78 | chmod 400 $dir/settings.php |
||
79 | done |
||
80 | |||
81 | ######### drupal 7 |
||
82 | for dir in `find $d7_dir_sites -type d -maxdepth 1 -mindepth 1 ! -name all` ; do |
||
83 | chmod 755 $dir |
||
84 | chmod 400 $dir/settings.php |
||
85 | done |
||
86 | |||
87 | ####### bin |
||
88 | chmod -R 700 $dir_scripts |
||
89 | 35 | Florent Torregrosa | |
90 | ####### backup |
||
91 | chmod -R 700 $dir_backup |
||
92 | |||
93 | ####### log |
||
94 | chmod -R 700 $dir_log |
||
95 | 21 | Florent Torregrosa | </code> |
96 | </pre> |
||
97 | |||
98 | 1 | Julien Enselme | h2. contrib-usage.sh |
99 | 21 | Florent Torregrosa | |
100 | <pre> |
||
101 | <code class="php"> |
||
102 | #!/bin/sh |
||
103 | |||
104 | . scripts-config.sh |
||
105 | . scripts-utils.sh |
||
106 | |||
107 | # ARGS: Drupal_version, project_status, project_name |
||
108 | # List sites that have the project_name with the corresponding project_status. |
||
109 | 29 | Florent Torregrosa | # project status: enabled or disabled |
110 | 21 | Florent Torregrosa | |
111 | check_arguments $# 3 |
||
112 | |||
113 | if [ $1 = d6 ] ; then |
||
114 | cd $d6_dir_sites |
||
115 | else |
||
116 | cd $d7_dir_sites |
||
117 | fi |
||
118 | |||
119 | for dir in `find . -maxdepth 1 -mindepth 1 -type d ! -name all ! -name languages ! -name images` ; do |
||
120 | # List non-core projects that correspond to the status. |
||
121 | # Keep project_name if listed. |
||
122 | # Count line result. 0 if not listed or 1 if listed. |
||
123 | # Print site_dir if listed. |
||
124 | |||
125 | cd $dir; |
||
126 | if [ 1 -eq `drush pml --no-core --status=$2 | grep $3 | wc -l` ] ; then |
||
127 | echo $dir; |
||
128 | fi |
||
129 | 29 | Florent Torregrosa | cd - |
130 | 21 | Florent Torregrosa | done |
131 | </code> |
||
132 | </pre> |
||
133 | |||
134 | 1 | Julien Enselme | h2. d6-all-drush.sh |
135 | 21 | Florent Torregrosa | |
136 | <pre> |
||
137 | <code class="php"> |
||
138 | #!/bin/sh |
||
139 | |||
140 | . scripts-config.sh |
||
141 | . scripts-utils.sh |
||
142 | |||
143 | # ARGS: drush_command |
||
144 | |||
145 | check_arguments $# 1 |
||
146 | |||
147 | for dir in `find $d6_dir_sites -maxdepth 1 -mindepth 1 -type d ! -name all ! -name languages ! -name images` ; do |
||
148 | cd $dir |
||
149 | echo $dir |
||
150 | drush $* |
||
151 | done |
||
152 | </code> |
||
153 | </pre> |
||
154 | |||
155 | 1 | Julien Enselme | h2. d6-all-dump-full.sh |
156 | 21 | Florent Torregrosa | |
157 | <pre> |
||
158 | <code class="php"> |
||
159 | #!/bin/sh |
||
160 | |||
161 | . scripts-config.sh |
||
162 | |||
163 | current_date=`date "+%Y-%m-%d-%Hh%Mm%Ss"` |
||
164 | |||
165 | # Dump D6 database with webassos user. |
||
166 | mysqldump --single-transaction webassos -h myweb.serv.int -u webassos --password=HBVH2ljgyZCA0AP251DY > $d6_dir_full_backup/webassos/$current_date.webassos.sql |
||
167 | |||
168 | # Dump D6 form database with forum user. |
||
169 | mysqldump forum -h myweb.serv.int -u forum --password=dtcAltF12 > $d6_dir_full_backup/forum/$current_date.forum.sql |
||
170 | </code> |
||
171 | </pre> |
||
172 | |||
173 | 1 | Julien Enselme | h2. d6-all-update-contrib.sh |
174 | 21 | Florent Torregrosa | |
175 | <pre> |
||
176 | <code class="php"> |
||
177 | #!/bin/sh |
||
178 | |||
179 | . scripts-config.sh |
||
180 | |||
181 | d6-all-drush.sh -y en update |
||
182 | # Launch cron to check for updates. |
||
183 | d6-all-drush.sh -q cron |
||
184 | |||
185 | d6-all-drush.sh cc all |
||
186 | d6-all-dump-full.sh |
||
187 | |||
188 | d6-all-drush.sh -y upc --no-core |
||
189 | d6-all-drush.sh -y updb |
||
190 | |||
191 | d6-all-drush.sh -y dis update |
||
192 | |||
193 | # Cron report. |
||
194 | d6-all-drush.sh cron |
||
195 | </code> |
||
196 | </pre> |
||
197 | |||
198 | 1 | Julien Enselme | h2. d6-dump-individual.sh |
199 | 21 | Florent Torregrosa | |
200 | <pre> |
||
201 | <code class="php"> |
||
202 | #!/bin/sh |
||
203 | |||
204 | . scripts-config.sh |
||
205 | |||
206 | # ARGS: auto or manual, site_prefix |
||
207 | # WARNING : backup are regularly flushed, put your backup in a safe place. |
||
208 | |||
209 | cd $dir_individual_backup |
||
210 | |||
211 | #récupération des tables du site dans le fichier liste_tables.temp |
||
212 | tables='_%' |
||
213 | liste="$1$tables" |
||
214 | |||
215 | mysql -h myweb.serv.int -u webassos --password=HBVH2ljgyZCA0AP251DY -BNe "show tables like '"$liste"'" webassos | tr '\r\n' ' ' > liste_tables.temp |
||
216 | |||
217 | #transformation de cette liste en une variable |
||
218 | var=$(cat liste_tables.temp) |
||
219 | |||
220 | #sauvegarde de toutes ces tables |
||
221 | current_date=`date "+%Y-%m-%d-%Hh%Mm%Ss"` |
||
222 | suffixe="_dump$current_date.sql" |
||
223 | fichier="$1$suffixe" |
||
224 | |||
225 | if [ $1 = 'auto' ] ; then |
||
226 | mysqldump webassos -h myweb.serv.int -u webassos --password=HBVH2ljgyZCA0AP251DY $var > $d6_dir_individual_auto_backup/$fichier |
||
227 | else |
||
228 | mysqldump webassos -h myweb.serv.int -u webassos --password=HBVH2ljgyZCA0AP251DY $var > $d6_dir_individual_manual_backup/$fichier |
||
229 | fi |
||
230 | |||
231 | #suppression du fichier temporaire utilisé |
||
232 | rm liste_tables.temp |
||
233 | </code> |
||
234 | </pre> |
||
235 | |||
236 | 1 | Julien Enselme | h2. d6-reset-variables.sh |
237 | 21 | Florent Torregrosa | |
238 | <pre> |
||
239 | <code class="php"> |
||
240 | #!/bin/sh |
||
241 | |||
242 | . scripts-config.sh |
||
243 | |||
244 | cd $d6_dir_sites |
||
245 | d6-all-drush.sh vset --always-set reverse_proxy TRUE |
||
246 | d6-all-drush.sh vset --always-set --format=json reverse_proxy_addresses '["147.94.19.16","147.94.19.17"]' |
||
247 | drush @sites ev "variable_set('update_notify_emails', array($email_multi_assos));" --yes |
||
248 | </code> |
||
249 | </pre> |
||
250 | |||
251 | 1 | Julien Enselme | h2. d7-all-drush-logged.sh |
252 | 21 | Florent Torregrosa | |
253 | <pre> |
||
254 | <code class="php"> |
||
255 | #!/bin/sh |
||
256 | |||
257 | . scripts-config.sh |
||
258 | . scripts-utils.sh |
||
259 | |||
260 | # ARGS: drush_command |
||
261 | |||
262 | check_arguments $# 1 |
||
263 | |||
264 | 30 | Florent Torregrosa | cd $d7_dir_sites |
265 | |||
266 | for dir in `find . -maxdepth 1 -mindepth 1 -type d ! -name all` ; do |
||
267 | 1 | Julien Enselme | cd $dir |
268 | current_date=`date "+%Y-%m-%d_%Hh:%Mm"` |
||
269 | 30 | Florent Torregrosa | echo "======$current_date======" >> $d7_dir_log/$dir.log |
270 | echo "Arguments are: $* " >> $d7_dir_log/$dir.log |
||
271 | drush $* >> $d7_dir_log/$dir.log |
||
272 | 21 | Florent Torregrosa | #To have the same caracters limit we needed 'end' that have 4 caracters, we used the Croate language for this ! LOL |
273 | 30 | Florent Torregrosa | echo -e "=============KRAJ=============\n" >> $d7_dir_log/$dir.log |
274 | cd - |
||
275 | 21 | Florent Torregrosa | done |
276 | </code> |
||
277 | </pre> |
||
278 | |||
279 | 1 | Julien Enselme | h2. d7-all-drush.sh |
280 | 21 | Florent Torregrosa | |
281 | <pre> |
||
282 | <code class="php"> |
||
283 | #!/bin/sh |
||
284 | |||
285 | . scripts-config.sh |
||
286 | . scripts-utils.sh |
||
287 | |||
288 | # ARGS: drush_command |
||
289 | |||
290 | check_arguments $# 1 |
||
291 | |||
292 | for dir in `find $d7_dir_sites -maxdepth 1 -mindepth 1 -type d ! -name all` ; do |
||
293 | cd $dir |
||
294 | echo $dir |
||
295 | drush $* |
||
296 | done |
||
297 | </code> |
||
298 | </pre> |
||
299 | |||
300 | 1 | Julien Enselme | h2. d7-all-dump-full.sh |
301 | 21 | Florent Torregrosa | |
302 | <pre> |
||
303 | <code class="php"> |
||
304 | #!/bin/sh |
||
305 | |||
306 | . scripts-config.sh |
||
307 | |||
308 | current_date=`date "+%Y-%m-%d-%Hh%Mm%Ss"` |
||
309 | |||
310 | # Dump D7 databases at once. |
||
311 | mysqldump -h $db_server -u $db_user -pNoNo82jJ --all-databases > $d7_dir_full_backup/myassos/$current_date.d7_full.sql |
||
312 | </code> |
||
313 | </pre> |
||
314 | |||
315 | 1 | Julien Enselme | h2. d7-all-dump-individual.sh |
316 | 21 | Florent Torregrosa | |
317 | <pre> |
||
318 | <code class="php"> |
||
319 | #!/bin/sh |
||
320 | |||
321 | . scripts-config.sh |
||
322 | |||
323 | # ARGS: auto or manual |
||
324 | |||
325 | current_date=`date "+%Y-%m-%d-%Hh%Mm%Ss"` |
||
326 | |||
327 | 34 | Florent Torregrosa | cd $d7_dir_sites |
328 | |||
329 | for dir in `find . -maxdepth 1 -mindepth 1 -type d ! -name all | cut -c3-` ; do |
||
330 | 21 | Florent Torregrosa | cd $dir |
331 | drush cc all |
||
332 | if [ $1 = 'auto' ] ; then |
||
333 | drush sql-dump --result-file="$d7_dir_individual_auto_backup/$dir/$current_date.$dir.sql" |
||
334 | else |
||
335 | 36 | Florent Torregrosa | # TODO : the script doesn't work whit manual |
336 | # drush sql-dump --result-file="$d7_dir_individual_manual_backup/$dir/$current_date.$dir.sql" |
||
337 | 1 | Julien Enselme | fi |
338 | 34 | Florent Torregrosa | cd - |
339 | 21 | Florent Torregrosa | done |
340 | </code> |
||
341 | </pre> |
||
342 | |||
343 | 1 | Julien Enselme | h2. d7-all-releases-info.sh |
344 | 21 | Florent Torregrosa | |
345 | <pre> |
||
346 | <code class="php"> |
||
347 | #!/bin/sh |
||
348 | |||
349 | . scripts-config.sh |
||
350 | |||
351 | # List version of a module or theme that exists in sites/all/* |
||
352 | # and all versions that are available for same project on drupal.org |
||
353 | |||
354 | # modules |
||
355 | 28 | Florent Torregrosa | cd $d7_dir_sites/all/modules |
356 | for dir in `ls -1` ; do |
||
357 | if [ -d $dir ] ; then |
||
358 | drush pm-releases $dir |
||
359 | fi |
||
360 | 1 | Julien Enselme | done |
361 | |||
362 | # themes |
||
363 | 28 | Florent Torregrosa | cd $d7_dir_sites/all/themes |
364 | for dir in `ls -1` ; do |
||
365 | if [ -d $dir ] ; then |
||
366 | drush pm-releases $dir |
||
367 | fi |
||
368 | 21 | Florent Torregrosa | done |
369 | </code> |
||
370 | </pre> |
||
371 | |||
372 | 1 | Julien Enselme | h2. d7-all-reset-variables.sh |
373 | 21 | Florent Torregrosa | |
374 | <pre> |
||
375 | <code class="php"> |
||
376 | #!/bin/sh |
||
377 | |||
378 | . scripts-config.sh |
||
379 | |||
380 | for dir in `find $d7_dir_sites -maxdepth 1 -mindepth 1 -type d ! -name all` ; do |
||
381 | cd $dir |
||
382 | echo $dir |
||
383 | d7-reset-variables.sh |
||
384 | done |
||
385 | </code> |
||
386 | </pre> |
||
387 | |||
388 | 1 | Julien Enselme | h2. d7-all-security-review.sh |
389 | 21 | Florent Torregrosa | |
390 | <pre> |
||
391 | <code class="php"> |
||
392 | #!/bin/sh |
||
393 | |||
394 | . scripts-config.sh |
||
395 | |||
396 | # grep -v success to keep site_name and error lines. |
||
397 | bash -c 'd7-all-drush.sh security-review |& grep -v success | mail -s "Security review" $email_multi_assos' |
||
398 | </code> |
||
399 | </pre> |
||
400 | |||
401 | 1 | Julien Enselme | h2. d7-all-update-contrib.sh |
402 | 21 | Florent Torregrosa | |
403 | <pre> |
||
404 | <code class="php"> |
||
405 | #!/bin/sh |
||
406 | |||
407 | . scripts-config.sh |
||
408 | |||
409 | d7-all-drush.sh -y en update |
||
410 | # Launch cron to check for updates. |
||
411 | d7-all-drush.sh -q cron |
||
412 | |||
413 | d7-all-drush.sh cc all |
||
414 | d7-all-dump-individual.sh |
||
415 | |||
416 | d7-all-drush-logged.sh -y upc --no-core |
||
417 | d7-all-drush.sh -y updb |
||
418 | |||
419 | d7-all-drush.sh -y dis update |
||
420 | |||
421 | # Cron report. |
||
422 | d7-all-drush.sh cron | mail -s "Cron report: d7-all-update-contrib.sh" $email_multi_assos |
||
423 | </code> |
||
424 | </pre> |
||
425 | |||
426 | 1 | Julien Enselme | h2. d7-all-update-localisation.sh |
427 | 21 | Florent Torregrosa | |
428 | <pre> |
||
429 | <code class="php"> |
||
430 | #!/bin/sh |
||
431 | |||
432 | . scripts-config.sh |
||
433 | |||
434 | d7-all-drush.sh -y en l10n_update |
||
435 | d7-all-drush.sh l10n-update-refresh |
||
436 | d7-all-drush.sh l10n-update |
||
437 | d7-all-drush.sh -y dis l10n_update |
||
438 | </code> |
||
439 | </pre> |
||
440 | |||
441 | 1 | Julien Enselme | h2. d7-create-site.sh |
442 | 21 | Florent Torregrosa | |
443 | <pre> |
||
444 | <code class="php"> |
||
445 | #!/bin/sh |
||
446 | |||
447 | . scripts-config.sh |
||
448 | . scripts-config-site.sh $1 |
||
449 | . scripts-utils.sh |
||
450 | |||
451 | # ARGS: site name |
||
452 | |||
453 | ######## Exceptions |
||
454 | check_arguments $# 1 |
||
455 | |||
456 | # "-" is forbidden because it provokes database error. |
||
457 | 31 | Julien Enselme | if [ `echo $1 | grep -` ] ; then |
458 | 21 | Florent Torregrosa | echo '"-" is forbidden in the site name' |
459 | exit 1 |
||
460 | fi |
||
461 | |||
462 | # Site name length must be lower or equal to 16 due to database limitations. |
||
463 | 31 | Julien Enselme | if [ $(echo $1 | wc -c) -gt 16 ] ; then |
464 | 21 | Florent Torregrosa | echo "site name can't have more than 16 characters" |
465 | exit 1 |
||
466 | fi |
||
467 | |||
468 | ###### Initialisation |
||
469 | cd $d7_dir |
||
470 | db_password=`ask_password_db $db_server $db_user` |
||
471 | 31 | Julien Enselme | site_password=`generate_password` |
472 | 21 | Florent Torregrosa | |
473 | # Check if site database already exists. |
||
474 | if mysql -h $db_server -u $db_user -e "USE $d7_site_name" -p$db_password 2>/dev/null ; then |
||
475 | echo "Database $d7_site_name already exists" |
||
476 | exit 1 |
||
477 | fi |
||
478 | |||
479 | # Check if site folder already exists. |
||
480 | if [ -d $d7_site_dir ] ; then |
||
481 | echo "Folder $d7_site_dir already exists" |
||
482 | exit 1 |
||
483 | fi |
||
484 | 1 | Julien Enselme | |
485 | 21 | Florent Torregrosa | ###### Main |
486 | 1 | Julien Enselme | mkdir $d7_site_dir |
487 | 31 | Julien Enselme | dir_site_name="assos.centrale-marseille.fr.$d7_site_name" |
488 | 1 | Julien Enselme | |
489 | # Backup requirements |
||
490 | 31 | Julien Enselme | mkdir $d7_dir_individual_auto_backup/$dir_site_name |
491 | mkdir $d7_dir_individual_manual_backup/$dir_site_name |
||
492 | 21 | Florent Torregrosa | current_date=`date "+%Y-%m-%d-%Hh%Mm%Ss"` |
493 | |||
494 | 31 | Julien Enselme | # NB : ls sort by considering the 1st characters |
495 | touch $d7_dir_individual_auto_backup/$dir_site_name/$current_date.$dir_site_name.sql |
||
496 | touch $d7_dir_individual_auto_backup/$dir_site_name/$current_date.$dir_site_name.sql2 |
||
497 | touch $d7_dir_individual_auto_backup/$dir_site_name/$current_date.$dir_site_name.sql3 |
||
498 | 21 | Florent Torregrosa | |
499 | # Create and grant privileges on database |
||
500 | mysql -h $db_server -u $db_user -e "CREATE DATABASE $d7_site_name" -p$db_password |
||
501 | mysql -h $db_server -u $db_user -e "GRANT ALL PRIVILEGES ON $d7_site_name.* TO '$d7_site_name'@'%' IDENTIFIED BY '$site_password'" -p$db_password |
||
502 | |||
503 | # Create settings.php |
||
504 | sed "s/\%\%DBUSER\%\%/$d7_site_name/ ; s/\%\%DBNAME\%\%/$d7_site_name/ ; s/\%\%DBPASS\%\%/$site_password/ ; s/\%\%nomsite\%\%/$d7_site_name/" < $d7_settings_template > $d7_site_settings |
||
505 | |||
506 | # Create symbolic link |
||
507 | cd $d7_dir |
||
508 | ln -s . $d7_site_name |
||
509 | |||
510 | # Next Instructions |
||
511 | echo "Go to http://assos.centrale-marseille.fr/$d7_site_name/install.php to continue." |
||
512 | echo "Press enter when ready to go on." |
||
513 | read key |
||
514 | |||
515 | # Init variables |
||
516 | d7-reset-variables.sh $d7_site_name |
||
517 | |||
518 | # Permissions |
||
519 | chmod -R 755 $d7_site_dir |
||
520 | chmod 400 $d7_site_settings |
||
521 | |||
522 | # Last instructions |
||
523 | echo "Last instructions:" |
||
524 | echo "- Advice the webmaster to close account creation on the website" |
||
525 | echo "- Give the webmaster a link to the club Drupal's tutorials " |
||
526 | echo "- Create a node of type \"Site\" on default" |
||
527 | echo "- Register the webmaster on webmasters@listes.centrale-marseille.fr" |
||
528 | </code> |
||
529 | </pre> |
||
530 | |||
531 | 1 | Julien Enselme | h2. d7-delete-site.sh |
532 | 21 | Florent Torregrosa | |
533 | <pre> |
||
534 | <code class="php"> |
||
535 | #!/bin/sh |
||
536 | |||
537 | . scripts-config.sh |
||
538 | . scripts-config-site.sh $1 |
||
539 | . scripts-utils.sh |
||
540 | |||
541 | # ARGS: site name. |
||
542 | |||
543 | check_arguments $# 1 |
||
544 | |||
545 | db_password=`ask_password_db $db_server $db_user` |
||
546 | |||
547 | # Delete database. |
||
548 | mysql -h $db_server -u $db_user -p$db_password -e "IF EXISTS DROP DATABASE $d7_site_name" |
||
549 | |||
550 | # Delete MYSQL user. |
||
551 | mysql -h $db_server -u $db_user -p$db_password -e "DROP USER '$d7_site_name'@'%'" |
||
552 | |||
553 | # Delete site's folder. |
||
554 | chmod -R 700 $d7_site_dir |
||
555 | rm -r $d7_site_dir |
||
556 | |||
557 | # Delete symbolic link. |
||
558 | rm $d7_dir/$d7_site_name |
||
559 | |||
560 | # Delete database backups. |
||
561 | rm -r $d7_dir_individual_auto_backup/assos.centrale-marseille.fr.$d7_site_name |
||
562 | rm -r $d7_dir_individual_manual_backup/assos.centrale-marseille.fr.$d7_site_name |
||
563 | |||
564 | echo "Don't forget to:" |
||
565 | echo "- Refresh node site on default" |
||
566 | echo "- Check particular behavior (normally detailed on site node)" |
||
567 | </code> |
||
568 | </pre> |
||
569 | |||
570 | 1 | Julien Enselme | h2. d7-reset-variables.sh |
571 | 21 | Florent Torregrosa | |
572 | <pre> |
||
573 | <code class="php"> |
||
574 | #!/bin/sh |
||
575 | |||
576 | . scripts-config.sh |
||
577 | |||
578 | # ARGS: [site_name] |
||
579 | |||
580 | if [ ! -z $1 ] ; then |
||
581 | . scripts-config-site.sh $1 |
||
582 | cd $d7_site_dir |
||
583 | fi |
||
584 | |||
585 | current_timestamp=`date "+%s"` |
||
586 | |||
587 | ####### General variables |
||
588 | drush -y vset --always-set reverse_proxy TRUE |
||
589 | drush -y vset --always-set --format=json reverse_proxy_addresses '["147.94.19.16","147.94.19.17"]' |
||
590 | drush -y ev "variable_set('update_notify_emails', array($email_multi_assos));" |
||
591 | drush -y vset error_level 0 |
||
592 | |||
593 | ###### Hidden captcha |
||
594 | drush -y en hidden_captcha |
||
595 | # Log wrong answers. |
||
596 | drush -y vset captcha_log_wrong_responses 1 |
||
597 | # Use hidden captcha for all forms. |
||
598 | drush -y sqlq --db-prefix "UPDATE {captcha_points} SET module = 'hidden_captcha', captcha_type = 'Hidden CAPTCHA' WHERE module is NULL;" |
||
599 | # Flush captcha cache. |
||
600 | drush -y vdel captcha_placement_map_cache |
||
601 | # Randomely generate a math question as the label of the hidden captcha field. |
||
602 | drush -y vset hidden_captcha_label "$RANDOM + $RANDOM" |
||
603 | |||
604 | |||
605 | ####### Piwik |
||
606 | drush -y en piwik |
||
607 | drush -y vset piwik_site_id "101" |
||
608 | drush -y vset piwik_url_http "http://piwik.centrale-marseille.fr/" |
||
609 | drush -y vset piwik_url_https "https://piwik.centrale-marseille.fr/" |
||
610 | # Piwik cache. |
||
611 | drush -y vset piwik_cache 1 |
||
612 | drush -y vset piwik_visibility_roles "1" |
||
613 | 32 | Julien Enselme | # Piwik is enable for everyone except the administrator |
614 | 33 | Julien Enselme | drush -y vset --format=json piwik_roles '[3]' |
615 | 21 | Florent Torregrosa | drush -y vset piwik_page_title_hierarchy 1 |
616 | # Activate local search. |
||
617 | drush -y vset piwik_site_search 1 |
||
618 | |||
619 | |||
620 | ###### Security review |
||
621 | # For untrusted roles: |
||
622 | # 1 : anonymous user |
||
623 | # 2 : authenticated user |
||
624 | # 3 : administrator |
||
625 | drush -y en security_review |
||
626 | drush -y ev "variable_set('security_review_untrusted_roles', array('1'));" |
||
627 | # Security review can't check for files permissions on multi_assos. |
||
628 | drush -y sqlq --db-prefix "UPDATE {security_review} SET skip = '1', skiptime = $current_timestamp, skipuid= '1' WHERE reviewcheck IN ('file_perms');" |
||
629 | drush -y sqlq --db-prefix "UPDATE {security_review} SET skip = '0', skiptime = 0, skipuid= NULL WHERE reviewcheck NOT IN ('file_perms');" |
||
630 | </code> |
||
631 | </pre> |
||
632 | |||
633 | 1 | Julien Enselme | h2. delete-temporary-files.sh |
634 | 21 | Florent Torregrosa | |
635 | <pre> |
||
636 | <code class="php"> |
||
637 | #!/bin/sh |
||
638 | |||
639 | . scripts-config.sh |
||
640 | |||
641 | find $dir_multi_assos -name '*~' -delete |
||
642 | </code> |
||
643 | </pre> |
||
644 | |||
645 | 1 | Julien Enselme | h2. disk-usage.sh |
646 | 21 | Florent Torregrosa | |
647 | <pre> |
||
648 | <code class="php"> |
||
649 | #!/bin/sh |
||
650 | |||
651 | . scripts-config.sh |
||
652 | |||
653 | echo -e "Quotas: 9.1 GB\n" |
||
654 | |||
655 | echo "Assos:" |
||
656 | du -hcs $dir_multi_assos | grep total |
||
657 | echo -e "\n" |
||
658 | |||
659 | echo "D6:" |
||
660 | cd $d6_dir_sites |
||
661 | du -h -d 1 |
||
662 | echo -e "\n" |
||
663 | |||
664 | echo "D7:" |
||
665 | cd $d7_dir_sites |
||
666 | du -h -d 1 |
||
667 | echo -e "\n" |
||
668 | |||
669 | echo "Logs:" |
||
670 | du -hcs $dir_log | grep total |
||
671 | echo -e "\n" |
||
672 | |||
673 | echo "Backups:" |
||
674 | cd $dir_backup |
||
675 | du -h -d 2 |
||
676 | </code> |
||
677 | </pre> |
||
678 | |||
679 | 1 | Julien Enselme | h2. flush-files.sh |
680 | 21 | Florent Torregrosa | |
681 | <pre> |
||
682 | <code class="php"> |
||
683 | #!/bin/sh |
||
684 | |||
685 | # ARGS: number of files to keep, email address |
||
686 | # usage: flush files from a folder except a number equal to argument. |
||
687 | |||
688 | # Check if scripts-config.sh is imported. |
||
689 | if [ -z $scripts_utils ] ; then |
||
690 | echo "Import of scripts-utils.sh required." |
||
691 | exit 1 |
||
692 | fi |
||
693 | |||
694 | check_arguments $# 2 |
||
695 | |||
696 | backups_number=`ls | wc -l` |
||
697 | let "number_of_backups_to_delete = backups_number - $1" |
||
698 | |||
699 | if [ $number_of_backups_to_delete -gt 0 ] ; then |
||
700 | ls | head -$number_of_backups_to_delete | xargs rm |
||
701 | else |
||
702 | dir=`pwd` |
||
703 | echo "There are not enough files in $dir to Flush it. Check if backup script works fine." | mail -s "[db] $dir has a backup problem" $2 |
||
704 | fi |
||
705 | </code> |
||
706 | </pre> |
||
707 | |||
708 | 1 | Julien Enselme | h2. flush-full-databases-backups.sh |
709 | 21 | Florent Torregrosa | |
710 | <pre> |
||
711 | <code class="php"> |
||
712 | #!/bin/sh |
||
713 | |||
714 | . scripts-config.sh |
||
715 | |||
716 | # ARGS: Drupal version |
||
717 | |||
718 | cd $dir_full_backup/$1 |
||
719 | |||
720 | for dir in `ls` ; do |
||
721 | cd $dir |
||
722 | flush-files.sh $db_full_backup_number $email_multi_assos |
||
723 | done |
||
724 | </code> |
||
725 | </pre> |
||
726 | |||
727 | 1 | Julien Enselme | h2. flush-individual-databases-backups.sh |
728 | 21 | Florent Torregrosa | |
729 | <pre> |
||
730 | <code class="php"> |
||
731 | #!/bin/sh |
||
732 | |||
733 | . scripts-config.sh |
||
734 | |||
735 | # ARGS: manual or auto, Drupal version |
||
736 | |||
737 | cd $dir_individual_backup/$1/$2 |
||
738 | |||
739 | for dir in `ls` ; do |
||
740 | cd $dir |
||
741 | if [ $1 = 'auto' ] ; then |
||
742 | flush-files.sh $db_individual_auto_backup_number $email_multi_assos |
||
743 | else |
||
744 | flush-files.sh $db_individual_manual_backup_number $email_multi_assos |
||
745 | fi |
||
746 | done |
||
747 | </code> |
||
748 | </pre> |
||
749 | |||
750 | 1 | Julien Enselme | h2. scripts-config-site.sh |
751 | 21 | Florent Torregrosa | |
752 | <pre> |
||
753 | <code class="php"> |
||
754 | #!/bin/sh |
||
755 | |||
756 | # Sets useful variables of a site. |
||
757 | # ARGS: site_name |
||
758 | # Requires scripts-config.sh |
||
759 | |||
760 | # Check if scripts-config.sh is imported. |
||
761 | if [ -z $scripts_config ] ; then |
||
762 | echo "Import of scripts-config.sh required." |
||
763 | exit 1 |
||
764 | fi |
||
765 | |||
766 | if [ -z $1 ] ; then |
||
767 | echo "This script needs a site name as argument." |
||
768 | exit 1 |
||
769 | fi |
||
770 | |||
771 | scripts_config_site='imported' |
||
772 | |||
773 | d7_site_name=$1 |
||
774 | d7_site_dir="$d7_dir_sites/assos.centrale-marseille.fr.$d7_site_name" |
||
775 | d7_site_settings="$d7_site_dir/settings.php" |
||
776 | </code> |
||
777 | </pre> |
||
778 | |||
779 | 1 | Julien Enselme | h2. scripts-config.sh |
780 | 21 | Florent Torregrosa | |
781 | <pre> |
||
782 | <code class="php"> |
||
783 | #!/bin/sh |
||
784 | |||
785 | PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/games:/usr/local/sbin:/usr/local/bin:/users/guest/assos/bin |
||
786 | PATH=$PATH:/usr/guest/assos/bin |
||
787 | |||
788 | scripts_config='imported' |
||
789 | |||
790 | email_multi_assos="assos@centrale-marseille.fr" |
||
791 | |||
792 | dir_multi_assos='/users/guest/assos' |
||
793 | dir_scripts="$dir_multi_assos/bin" |
||
794 | dir_template="$dir_multi_assos/Desktop" |
||
795 | |||
796 | ###### Database |
||
797 | db_server="myassos.serv.int" |
||
798 | db_user="assos" |
||
799 | dir_log="$dir_multi_assos/log" |
||
800 | |||
801 | ###### Backup |
||
802 | db_full_backup_number=3 |
||
803 | db_individual_manual_backup_number=3 |
||
804 | db_individual_auto_backup_number=3 |
||
805 | |||
806 | dir_backup="$dir_multi_assos/backup" |
||
807 | dir_full_backup="$dir_backup/full" |
||
808 | dir_individual_backup="$dir_backup/individual" |
||
809 | dir_individual_manual_backup="$dir_individual_backup/manual" |
||
810 | dir_individual_auto_backup="$dir_individual_backup/auto" |
||
811 | |||
812 | |||
813 | ###### D7 variables |
||
814 | d7_dir="$dir_multi_assos/htmltest" |
||
815 | d7_dir_sites="$d7_dir/sites" |
||
816 | |||
817 | ### Log |
||
818 | d7_dir_log="$dir_log/d7" |
||
819 | |||
820 | ### Backup |
||
821 | d7_dir_full_backup="$dir_full_backup/d7" |
||
822 | d7_dir_individual_manual_backup="$dir_individual_manual_backup/d7" |
||
823 | d7_dir_individual_auto_backup="$dir_individual_auto_backup/d7" |
||
824 | |||
825 | ### Template |
||
826 | d7_settings_template_name="settings-D7-bddinde-template.php" |
||
827 | d7_settings_template="$dir_template/$d7_settings_template_name" |
||
828 | |||
829 | |||
830 | ###### D6 variables |
||
831 | d6_dir="$dir_multi_assos/html" |
||
832 | d6_dir_sites="$d6_dir/sites" |
||
833 | |||
834 | ### Backup |
||
835 | d6_dir_full_backup="$dir_full_backup/d6" |
||
836 | d6_dir_individual_manual_backup="$dir_individual_manual_backup/d6" |
||
837 | d6_dir_individual_auto_backup="$dir_individual_auto_backup/d6" |
||
838 | </code> |
||
839 | </pre> |
||
840 | |||
841 | 1 | Julien Enselme | h2. scripts-utils.sh |
842 | 21 | Florent Torregrosa | |
843 | <pre> |
||
844 | <code class="php"> |
||
845 | #!/bin/sh |
||
846 | |||
847 | # This script contains useful functions for other scripts. |
||
848 | |||
849 | # Check if scripts-config.sh is imported. |
||
850 | if [ -z $scripts_config ] ; then |
||
851 | echo "Import of scripts-config.sh required." |
||
852 | exit 1 |
||
853 | fi |
||
854 | |||
855 | scripts_utils='imported' |
||
856 | |||
857 | ask_password() { |
||
858 | # read -s doesn't work with sh. |
||
859 | # usage: pass=`ask_password "password please:"` |
||
860 | echo $1 >&2 |
||
861 | echo -n ">" >&2 |
||
862 | stty_avant=`stty -g` |
||
863 | stty -echo |
||
864 | read p |
||
865 | stty $stty_avant |
||
866 | echo "$p" |
||
867 | unset p |
||
868 | } |
||
869 | |||
870 | ask_password_db() { |
||
871 | # ARGS: server_name, user_name |
||
872 | local db_password="pour_boucler" |
||
873 | # empty db request to validate password |
||
874 | while ! mysql -h $1 -u $2 -p$db_password -e "" 2>/dev/null ; do |
||
875 | db_password=`ask_password "database password:"` |
||
876 | echo "" |
||
877 | done |
||
878 | } |
||
879 | |||
880 | generate_password(){ |
||
881 | # ARGS: [password_length] |
||
882 | # The password contains special characters. '/' must be excluded to avoid sed malfunction. |
||
883 | |||
884 | local site_password='/' |
||
885 | |||
886 | if [ -z $1 ] ; then |
||
887 | local password_length=20 |
||
888 | else |
||
889 | local password_length=$1 |
||
890 | fi |
||
891 | |||
892 | while echo "$site_password" | grep -Fq '/' ; do |
||
893 | site_password=`dd if=/dev/urandom count=1 | uuencode -m - | head -n 2 | tail -n 1 | cut -c-$password_length` |
||
894 | done |
||
895 | |||
896 | echo $site_password |
||
897 | } |
||
898 | |||
899 | count_d7_sites(){ |
||
900 | find $d7_dir_sites -type d ! -name all -maxdepth 1 | wc -l |
||
901 | } |
||
902 | |||
903 | check_arguments() { |
||
904 | # ARGS: number of arguments passed to script, number of arguments required |
||
905 | if [ $1 -le $2 ] ; then |
||
906 | echo "Number of arguments insuffisant." |
||
907 | exit 1 |
||
908 | fi |
||
909 | } |
||
910 | 11 | Julien Enselme | </code> |
911 | </pre> |